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ABSTRACT 



In a region segmentation method for particle images, which 
photographs stained and non-stained object particles sup- 
plied through an image input optical system and which uses 
at least two of the red-colored image, green-colored image 
and blue-colored image to discriminate between a back- 
ground region and an object region where the object par- 
ticles exist, the region segmentation method includes the 
processes of: a first process of setting a first group of 
thresholds in density value for a first group of at least two 
images selected from the red-colored image, green -colored 
image and blue-colored image to extract regions greatly 
differing in density from the background region, and pro- 
ducing a first binary image from the first group of images; 
a second process of calculating for each pixel a quantity 
representing the magnitude of change of density in an area 
neighboring each of the pixels making up each of one or 
more second group images selected from the red-colored 
image, green-colored image and blue-colored image, com- 
paring a change of density in the background region with the 
quantity representing the magnitude of change of density 
calculated for each pixel, setting a second group of thresh- 
olds for extracting regions whose cane of density is larger 
than tat of the background region, and producing a second 
binary image from the second group of images; and a third 
process of performing a logic operation on the first binary 
image and the second binary image to produce a third binary 
image showing the background region and the object region. 

44 Claims, 25 Drawing Sheets 
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1 

REGION SEGMENTATION METHOD FOR 
PARTICLE IMAGES AND APPARATUS 
THEREOF 

BACKGROUND OF THE INVENTION 

The present invention relates to a region segmentation 
method for particle images that uses color information and 
density information and more particularly to a region seg- 
mentation method and apparatus suited for dividing particle 
images in blood and urine. 

To make a morphologic examination on particles in urine, 
the conventional visual method involves centrifuging a urine 
sample, dyeing sediments to make a urine specimen on a 
slide glass, and observing it with a microscope. In that case, 
the kind and density of sediments in the urine specimen are 
determined by centrifuging the sample to a fixed concen- 
tration level and observing a fixed amount of specimen. 
Contained in the sediments are a variety of sizes of particles, 
from several micrometers across, such as blood cells and 
bacteria or germs, to several hundred micrometers long such 
as columnar particles. These particles of varying sizes have 
been observed by changing the magnifying power of micro- 
scope between high and lower magnifying powers. 

The conventional visual examination by microscopic 
observation has drawbacks that (1) the method using a slide 
glass has low throughput and that (2) it is difficult to handle 
urine specimens that will quickly rot 

In recent years, a shift is being made from the conven- 
tional inspection method using slide glass specimens to a 
flow method that permits direct inspection of blood samples 
as a liquid specimen. The flow method is expected to realize 
a high-speed examination of specimens. 

A technique to analyze and classify particles based on 
individual particle images produced by imaging the particles 
in a continuously flowing sample is described in Japan 
Patent Laid-Open No. 500995/1982 and 9415671988. 

Japan Patent Laid-Open No. 500995/1982 describes a 
particle analyzing method, which involves passing a speci- 
men through a path of a special shape, flowing particles of 
the specimen into a wide imaging area, photographing a 
static image by using a flash lamp, and analyzing the 
particles based on the static image. When projecting an 
enlarged image of sample particles onto a CCD camera by 
using a microscope, a flash lamp as a pulse light source 
periodically flashes in synchronism with the operation of the 
CCD camera. The time in which the pulse light source is 
illuminated is so short that even when the particles are 
flowing continuously, their static images can be obtained. 
With the CCD camera, it is possible to shoot 30 static images 
a second. 

Japan Patent Laid-Open No. 9415671988 describes plac- 
ing an optical system for detecting passing particles — which 
is separate from the static image photographing system — at 
a position upstream of the particle imaging area for sample 
flow. In this method, when the particles are detected by the 
particle detector to reach the particle imaging area, the flash 
lamp is illuminated at an appropriate timing. This method, 
rather than flashing the pulse light source periodically, 
illuminates the flash lamp in synchronism with the detection 
of passage of particles to photograph a static image. As a 
result, it is possible to obtain particle images efficiently. In 
the case of a sample with low concentration, the static image 
of sample flow is not shot where no particles exist, thereby 
eliminating unnecessary image processing. 

Japan Patent Laid-Open No. 296915/1993 describes a 
method whereby an optical system for detecting particles is 



2 

incorporated into the particle imaging system. This method 
irradiates a laser light bundle against the sample flow 
through a microscopic condenser lens of the microscopic 
imag ing system to detect particles. With this method, there 

s is no need to prepare an optical system for detecting particles 
and the particle detection position can be put as close to the 
particle image intake area as possible. 

One example of such a conventional image area segmen- 
tation method is found in Japan Patent Laid-Open No. 

10 119765/1989, which describes a region segmentation 
method for classifying blood corpuscle images. This tech- 
nique divides an image area in the color space by using a 
threshold determined by gray level histogram of image. 

SUMMARY OF THE INVENTION 

13 in the case of a density distribution in which the density 
of the particle images to be analyzed is distributed over a 
wide range from low density to high density, however, the 
conventional technique cannot always offer precise region 
segmentation. Further, because the density distribution char- 

2D acteristic to be analyzed differs from one color tone to 
another, if a binary image of a number of particles is 
subjected to the same image processing, a correct region 
cannot always be obtained. 
In the case of urine sediments, the urine specimen is 

25 usually stained to prevent nusidentifkation of sediment 
component and to allow easy Judgment on the cell There are 
some known methods for photographing the image of 
stained biospecimen and extracting the object particles in the 
color space. In the urine sediment inspection apparatus. 

30 however, the object particles to be extracted by region 
segmentation have properties varying in wide ranges as 
shown below. 

( l)The size distribution of the object particles ranges widely 
from several pm Co several hundred pm. 
35 (2) A plurality of particles with different color tones exist in 
the same image. 

(3) The density of object particles may vary from small 
values to large values. 

(4) Even of the same kind, some cells stain dark and some 
40 stain light. 

(5) The object particles may have a density almost equal to 
or lower than the density of background. 

(6) Particles that are stained well and those that are not 
stained easily by specimen coloring (particles that do not 

45 stain well or nearly at all) are mixed. 

Because the object particles in the urine sediment inspec- 
tion apparatus have widely varying properties, the conven- 
tional region segmentation method cannot be applied as is. 
When the object particles are not stained well, there is 
50 almost no difference between the density of cytoplasm and 
the density of background, with the density becoming uni- 
form over the entire region where the object particles exist 
making it impossible to extract a precise binary image. 
Highly active cells have poor staining characteristics and 
55 there are those mat can hardly be stained. In an image 
containing such cells, because the color tone of the object 
region where the object particles exist and the color tone of 
background are almost same and there are many portions 
within the object region whose densities are almost equal to 
60 the density of the background, it is impossible to extract 
such cells correctly. 

When the object particles cannot be stained well and a 
correct binary image not extracted, the feature parameters of 
the object region cannot be determined precisely, leading to 
65 wrong discrimination of the object particles. 

Because object particles, such as cells, with poor staining 
characteristic are frequently encountered, the conventional 
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technique cannot always perform precise region segmenta- 
tion for all particles contained in the specimen, improvement 
of accuracy in discriminating the sediment components is 
expected. 

The above-mentioned problems are solved by this inven- 
tion in the following manner. That is. in a region segmen- 
tation method whereby particles scattered in a fluid are 
photographed and recorded as a static image and object 
particles are extracted from the static image, a first object of 
this invention is to provide a region segmentation method 
that can correctly extract particle images even with varying 
densities and color tones from the static image by perform- 
ing a stable region segmentation on the static image. 

A second object of this invention is to provide a region 
segmentation method that can extract particle images pre- 
cisely from the static image by performing stable region 
segmentation on the static image even when the difference 
in color tone between the particle images and the back- 
ground region is small and when the object region where 
object particles exist has many areas with densities almost 
equal to that of the background region. 

A third object of this invention is to provide a region 
segmentation method that can extract particle images pre- 
cisely from the static image by performing stable region 
segmentation on the static image even when the particle 
images have differing densities and differing color tones, 
when the difference in color tone between the particle 
images and the background region is small and when the 
object region where object particles exist has many areas 
with densities almost equal to or lower than that of the 
background region. 

<1> A first configuration to realize the first objective of 
this invention is described below. The first objective is 
realized by a region segmentation method, which photo- 
graphs a stained liquid flow specimen containing stained 
object particles, produces static images of the stained object 
particles from a red component image (red-colored image), 
a green component image (green-colored image) and a blue 
component image (blue-colored image) that are separated 
from each other by an image input optical system, and uses 
two or more of the red-colored image, green-colored image 
and blue-colored image to discriminate between a back- 
ground region and object regions where the object particles 
exist and which includes a process of selecting at least two 
images from the red-colored image, green-colored image 
and blue-colored image and correcting density irregularities 
present in the selected two images and caused by distortions 
of the image input optical system and another process of 
using the selected two images and a plurality of thresholds 
(Tl, T2, T3. T4), identifying the background region, gen- 
erating from the two images a binary image that shows the 
background region and regions other than the background 
region, i.e., object regions where object particles exist, and 
thereby extracting the object regions. With this configuration 
it is possible to extract object particles, urine sediment 
components to be identified, from the binary image. 

The correction of density irregularities caused by distor- 
tion of the image input optical system reduces deviation of 
density variation in at least the selected two images, allow- 
ing stable and correct discrimination and extraction of the 
background region. It is preferred that the green-colored 
image and the red-colored image be selected as the two 
images. 

In images obtained with the urine sedimentation inspec- 
tion apparatus, the background region is known to be 
normally stable. Hence, by taking the background region as 
a reference it is possible to discriminate object regions 
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where object particles exist That is. because the background 
region can be stably extracted, signal components represent- 
ing object particles to be discriminated from the background 
region can all be considered to be included in regions other 

s than the background region. 

The process of generating the binary image will be 
explained in the following, with the green-colored image 
and the red-colored image taken as the two selected images. 
The density histogram is produced for each of the green- 

10 colored image and the redcolored image, and the density 
value that gives the maximum peak value in the histogram 
is determined. Next thresholds Tl, T2 are determined from 
the density histogram of the red-colored image and thresh- 
olds 13. T4 from the density histogram of the green-colored 

j 5 image in order to extract the background region. 

The outline procedure for detennining the thresholds and 
extracting the background region is explained below. 

(Procedure 1) A density histogram is generated for each 
image (green-colored image and red-colored image). 

20 (Procedure 2) A density value (maximum density value) 
that has the maximum frequency in each density histogram 
is determined. 

(Procedure 3) A density that gives half the peak in each 
density histogram is determined. 

25 (Procedure 4) The thresholds Tl. T2, T3, T4 are calcu- 
lated from the maximum density value and the density 
giving the half of the peak, both determined in (Procedure 1) 
to (Procedure 3), and from predetermined parameters. 
(Procedure 5) Based on the thresholds Tl. T2, T3. T4 

30 calculated in (Procedure 1) to (Procedure 4). a binary image 
is generated in an image space. The background region is 
determined from Equation (1) below. 

{Tl SRfoKn }rv{T3<G(iJ)<T4} (I) 

35 where n represents a logical AND, (ij) represents the 
location of a pixel, and R(iJ) and G(i,j) represent the 
red-colored image and the green-colored image whose den- 
sity irregularities caused by distortion of the image input 
optical system were corrected 

40 In the first configuration of this invention, the above 
procedures allow accurate region segmentation even when 
the density of object particles in the images (images of a 
stained specimen that are to be region-segmented) is widely 
distributed from small to large values. Further, when the 

45 density distribution characteristics of objects vary depend- 
ing on color tones, accurate region segmentation can be 
performed. If, when extracting object particles from the 
images of stained specimens, the particle images have 
differences in density and color tone, the region segmenta- 

50 tion can be performed stably and accurately without being 
affected by the density and color tone differences. As a 
result, if the binary images after region segmentation are 
processed under the same condition, the object regions can 
be recognized precisely. 

55 <2> A second configuration to realize the second objec- 
tive of this invention is described below. The second objec- 
tive is realized by a region segmentation method, which 
photographs a stained liquid flow specimen containing 
stained object particles, produces static images of the stained 

60 object particles from a red component image (red-colored 
image), a green component image (green-colored image) 
and a blue component image (blue-colored image) that are 
separated from each other by an image input optical system, 
and uses one of the red-colored image, green-colored image 

65 and blue-colored image to discriminate between a back- 
ground region and object regions where the object particles 
exist, and which includes: a process of selecting one image 
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from the red-colored image, green -colored image and blue- can be extracted more accurately on the basis of the thresh- 

colored image and correcting density irregularities present in olds set for the magnitude of change of density, 

the selected image and caused by distortions of the image Further, in the urine sediment inspection apparatus 

input optical system; a process of setting a first group of required to extract object particles having widely varying 

thresholds (first and second threshold) in density value for 5 characteristics, when the object particles are not well stained 

the selected image to extract regions greatly differing in so that there is almost no difference in density between the 

density from the background region, and producing a first object particles and the. background region and when the 

binary image; a process of calculating for each point a specimen contains many such poorly stained particles with 

quantity representing the magnitude of change of density in high frequency, the second configuration of this invention 

an area neighboring each of the points making up the to makes it possible to extract the object particles. Even when 

selected image, comparing a change of density in the back- the specimen contains cells hardly stained so that the tone 

ground region with the quantity representing the magnitude difference is small between the background region and the 

of change of density calculated for each point setting a object regions where object particles exist and when the 

second group of thresholds (third threshold or fourth and object region contains many areas with density almost equal 

fifth threshold) for extracting regions whose change of 15 to or lower than that of the background region, the second 

density is larger than that of the background region, and configuration enables such object particles to be stably and 

producing a second binary image; and a process of perform- accurately extracted through simple computation without 

ing a logic operation, for example, logical OR, on the first reducing the processing speed. 

binary image and the second binary image to produce a third <3> A third configuration to realize the third objective of 
binary image that shows the background region and the 20 this invention is described below. The third objective is 
object region, other than the background region, where the realized by a region segmentation method, which photo- 
object particles exist for precise detection of the background graphs a stained liquid flow specimen containing stained 
region and the object region. object particles, produces static images of the stained object 

The quantity representing the magnitude of change of panicles from a red component image (red-colored image), 
density uses, for example. (1) a difference between sums of 25 a green component image (green-colored image) and a blue 
densities in each of two small adjacent areas in the image or component image (blue-colored image) that are separated 
an absolute value of the difference. (2) a variance or standard from each other by an image input optical system, and uses 
deviation of distribution of density in the small areas in the two or more of the red-colored image, green-colored image 
image. (3) a weighted sum of densities for pixels included in and blue-colored image to discriminate between a back- 
trie small areas in the image or an absolute value of the xi ground region and object regions where the object particles 
weighted sum. or (4) a value obtained by taking one of the exist and which includes: a step A of selecting at least two 
values of (1) to (3) (quantity representing the magnitude of images from the red-colored image, green-colored image 
change of density) as a new density value and performing and blue-colored image and correcting density irregularities 
the processes ( 1) to (3) one or more times. It is preferred that present in the selected two images and caused by distortions 
the green-colored image be selected as the image for the 35 of the image input optical system; a step B of selecting one 
above processing. of the two images and calculating for each point a quantity 

In the second configuration of this invention, when only representing the magnitude of change of density in an area 
positive values are used for the quantity representing the neighboring each of the points making up the selected 
magnitude of change of density (a value obtained by the image, comparing a change of density in the background 
above process (1) to (4)). if. abscissa indicates the density 40 region with the quantity representing the magnitude of 
for each point in the image and ordinate indicates the change of density calculated for each point, setting a first 
quantity representing the magnitude of change of density, group of thresholds (first threshold or second and third 
then the density distribution is such as shown in FIG. 1. in threshold) for extracting regions whose change of density is 
which the background region is represented by BG, an larger than that of the background region, and producing a 
object having density higher than that of the background 45 first binary image; A step C of setting a plurality of thresh- 
region is represented by Al. an object having density lower olds (Tl, T2, T3, T4) for the density of the two images, 
than that of the background region is represented by A2. and discriminating the background region in the selected image, 
an object whose density difference from the background and generating a second binary image that shows the back- 
region is small and the change of density is greater than that ground region and the object regions where the object 
of the background region is represented by B. Thresholds 50 particles exist; and a step D of performing a logic operation 
Tl', T2T are set for density and threshold T3' is set for the (logical OR) on the first binary image and the second binary 
magnitude of change of density to discriminate the back- image to produce a third binary image for detecting the 
ground region and the object regions in the image. object regions. 

When the quantity representing the magnitude of change It is preferred that the green-colored image and the 

of density assumes negative values, too. then the density 55 red-colored image be used as (he two images in the above 

distribution is such as shown in FIG. 2. in which the step A and that the green-colored image be used as the one 

background region is represented by BG. an object having selected image in the step B. Whichever of the step B and the 

density higher than that of the background region is repre- step C may be executed first It is more preferred that the 

sented by Al. an object having density lower than that of the step B and the step C be performed simultaneously to reduce 

background region is represented by A2, and an object 60 the processing time. 

whose density difference from the background region Is <4> A fourth configuration to realize the third objective of 

small and the change of density is greater than that of the this invention is described below. This is the configuration 

background region is represented by Bl and B2. In this case. which performs a logic operation (logical OR) on two or 

thresholds T1\T2' are set for density and threshold T3",T4* three of the binary images produced in the first to third 

are set for the magnitude of change of density to discrimi- 65 configuration to obtain another result of region segmenta- 

natc the background region and the object regions in the tion. In the first configuration, two or three images may be 

image. When the process (4) is applied, the object regions selected from the green-colored image, red-colored image 
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and blue-colored image and undergo processing to produce 
a plurality of third binary images. These third binary images 
may then be subjected to a logical operation, such as logical 
OR. to extract the object regions where the object particles 
exist 

In the third and fourth configuration of this invention, 
even when the stained specimen contains a mixture of well 
stained particles and particles not easily stained (those not 
well stained and those hardly stained), the region segmen- 
tation can be stably performed for each particle image, 
producing more precise binary images. This in turn allows 
the feature parameters of the object regions to be determined 
more precisely, preventing erroneous discrimination of the 
object particles. In this way. even when the specimen 
contains object particles having differing degrees of staining 
and poorly or hardly stained object particles, the method of 
this invention permits accurate region segmentation to be 
performed for each of the particle images, improving the 
discriminating rate of a variety of kinds of urine sediments. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 and FIG. 2 are diagrams explaining the working 
principle of the region segmentation method for particle 
image as a second embodiment of this invention; 

FIG. 3 Is a schematic diagram showing an example 
configuration of a urine sediment inspection apparatus that 
applies the region segmentation method of this Invention; 

FIG. 4 is a schematic diagram showing the region seg- 
mentation that extracts the background region in the color 
space of mis invention; 

FIG. 5 is a diagram showing a density histogram to obtain 
parameters for use in determining a threshold; 

FIG. 6 and FIG. 7 are example results of the region 
segmentation, in the first embodiment, performed on a cell 
image in which object particles are well stained and on a cell 
image in which object particles are hardly stained; 

FIG. 8 and FIG. 9 are example graphs showing densities 
of images containing well-stained cells and of images con- 
taining hardly stained cells, in the second embodiment of 
mis invention; 

FIG. 10 and FIG. 11 are example graphs showing vari- 
ances of images containing well stained cells and of Images 
containing hardly stained cells in the second embodiment of 
this invention; 

FIG. 12 and FIG. 13 are example graphs showing density 
differences of images containing well stained cells and of 
images containing hardly stained cells in the second embodi- 
ment of this invention; 

FIG. 14 and FIG. 15 are example results of the region 
segmentation, in the second embodiment, performed on a 
cell image containing well stained cells and on a cell image 
containing hardly stained cells, the region segmentation 
employing a method based on binarization using localized 
variance of density; 

FIG. 16 and FIG. 17 are example results of the region 
segmentation, in the second embodiment, performed on a 
cell image containing well stained cells and on a cell image 
containing hardly stained cells, the region segmentation 
employing a method based on binarization using difference 
of density; 

FIG. 18 is example results of region segmentation with 
mask size changed in the second embodiment of this inven- 
tion; 

FIG. 19 is an example result of discrete Fourier transfor- 
mation of a background region and an object region on one 
scan line in the second embodiment of this invention; 
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FIG. 20 is an example frequency-amplitude characteristic 
of filter (IH(Q)I) in the second embodiment of this invention; 

FIG. 21 A and 2 IB are example results of investigation 
into effects that the mask size has on the geometry of the 
S segmented regions in the second embodiment of this 
invention, the investigation being conducted by using red 
corpuscles; 

FIG. 22 is a flow chart showing the procedure of seg- 
menting regions of a particle image in the second embodi- 
10 ment of this invention; 

FIG. 23 is an example configuration of an apparatus for 
implementing the second embodiment of this invention; 

FIG. 24 is a block diagram showing an example configu- 
ration of the region segmentation unit of FIG. 23; 
15 FIG. 25. 26. 27 and 28 are example circuit configurations 
of a change of density calculation unit; 

FIG. 29 is a schematic diagram showing the combining of 
two binary images whose regions are segmented by two 
different methods in a fourth embodiment of this invention; 
20 FIG. 30 and FIG. 31 are example results of region 
segmentation of an actual specimen in a third embodiment 
of this invention; and 

FIG. 32 is an example configuration of an apparatus that 
applies the particle image region segmentation method of 
25 this invention. 

DESCRIPTION OF PREFERRED 
EMBODIMENTS 

First, a urine sediment inspection to which the method of 

3Q this invention can suitably be applied is described. 

The urine sediment specimen is often stained to prevent 
misidentifi cation of the sediment components and to make 
correct judgment of cells. Representative staining tech- 
niques include the Sternheimer-Malbin (SM) stain method 

35 and the Sternheimer (S) modified stain method. The SM 
stain method is mainly used widely for staining white blood 
cells. The S modified stain method (hereinafter referred to as 
S stain method) uses alcian blue or astral blue and Pyronin 
B. all basic dyes. This stain method has the advantage that 

40 because nuclei and cast stromata are clearly colored in blue 
and cytoplasms and RNA components are colored in red by 
Pyronin B, a high contrast between red and blue can be 
obtained. Many other stain methods are known. The urine 
sediment inspection uses stained specimens and makes 

45 many checks including discrimination of blood cells and 
columnar epithelial cells, counting of the number of these 
cells, identification of the kind of crystals, judgment on the 
presence or absence of germs including yeast-like fungi, and 
determination of the kind of germs. 

50 In the following embodiments we will explain the image 
region segmentation performed by a urine sediment inspec- 
tion apparatus that automatically analyzes solid materials 
(sediments) in urine dyed, for example, by Sternheimer 
modified stain method. 

55 In each of the following embodiments, the stained urine 
specimen is fed. without being centrifuged. into a flow cell 
that farms a flat sheath flow; in synchronism with sediment 
particles flowing in the flow cell, a pulse light is irradiated 
against the flow cell to photograph a static image of the 

eo flowing sediment particles with a TV camera; and the static 
image is subjected to an image processing to identify the 
urine sediments. The image processing referred to in the 
following embodiments is capable of high-speed processing 
in synchronism with the TV camera's imaging period of up 

65 to 1/30 seconds to identify a plurality of sediments (object 
particles to be inspected) present in the image photographed 
and recorded. 
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FIG. 3 shows an example configuration of the urine 

sediment inspection apparatus. A urine specimen 22 is ^-^OW^)- ( 3 > 

stained by being mixed with a slainer 24, is formed into a flat ™ = {^-^(f./H + oo 

shape of a specified thickness and width in a flow ceil 26, Hcre ^ wc ^ mc si2C of the small area of the white image 

and then flows at a uniform speed enclosed by a sheath 5 t0 ^ refcrcDCcd ^ MxN, (i'J*) represents coordbates to be 

liquid in a space of a specified dimension. In this apparatus, referenced and, 

a beam of light from a semiconductor laser 32 is irradiated 

against a particle detection area located before Che imaging i'={i/Mj 

area. The particles passing through the particle detection r=fJ/Nl (41 
area are detected by a particle detector 34. Based on a 10 

detection signal from the particle detector 34. a flash lamp where [ ] represents a gauss symbol. If. for instance, 

(Xe lamp) 30 is illuminated for a short predetermined period M=N=8. the size of the white image W will be such as can 

with a pre4etermined delay (a time taken by the particles to be covered by an area of 64x64 pixels, 

enter the imaging area from the particle detection area) to The reference value p a of black level and the reference 

photograph the imaging area with a TV camera 36 through is value a Q for white level are set to around p 9 =230 and a^=40 

an optical system (including objective and relay lenses). The for red-, green- and blue-colored images, 

output signal of the TV camera 36 is A/D-converted for each Influences of noise on white image can be reduced by 

wavelength of red-, greenand blue-colored images by an performing the smoothing process within the image or by 

image processing board in a personal computer 28 to quan- measuring a plurality of white images and averaging or 

tize these images into digital images of 512 pixelsx512 20 smoothing the measurements. This correction makes the 

pixels x8 bits (786.432 bytes of data) which are stored in an density of the photographed color image almost uniform 

image memory 38. At this time, the output of the A/D over the entire image. The image correction can of course be 

converter (not shown) has 0 for a black level of camera and omitted when the distortions of the optical system can be 

255 for a white level In the following processing, however, virtually ignored. 

to represent an object in a light absorption rate for conve- 25 These processes are commonly performed prior to the 

nience of processing, the black level is represented by 255 region segmentation in each of the following embodiments, 

and the white level by 0. (Embodiment 1) 

The image input optical system has a lens moving mecha- ^ ,Ms embodiment, for efficient division of particles of 
nism for magnification installed between the objective and different sizes (several micrometers to several hundred 
the camera, so that density irregularities occur due to dis- 30 micrometers) present in an image photographed by the flow 
tortion of the optical system. To correct and eliminate the method, an image that is input from the TV camera for each 
density irregularities, a gray level correction process is wavelength is corrected for the density irregularities of the 
performed before the region segmentation processing. This optical system and then the color space of red- and green- 
correction is done for each of the red-, green- and blue- colored images is divided between the background region 
colored images independently. The images that meet the 35 and me object region where object particles exist to produce 
most preferred conditions for the staining technique used on binary images representing the background region and the 
the specimen are selected beforehand as the images that are rc 8 ion includes object particles, 
to undergo the gray level correction. ™* embodiment locates and picks up aregion containing 
T . , A « . , A . x . sediment components from the image of specimen that is 
^™S c P hot ?8 ra P ^hedwhen^ Nereis no objectorw hen ^ highblue anTred contrasts 
" *■ > ect ^.r1 0nn ° pt1 ^ c ^*^* c «\ infi - which is suited for autonutild^mmation of object par- 
nitely small light absorption rate (a white image) and in an tfd examined. The region segmentation Is per- 
image photographed when an object has an infinitely large Jr ZTz ,v~T ^ . ^=7 : . *^ 
...fi~ JT ~ , IT ,. v • i ■ formed by taking the background region in the image as a 
light absorption rate (a black image), pixels in these images prfn, 7«tt,» „^T„ ,»_-„„ri«n th .T™.-.„„ 
theoreticaUy have uniform values. In reality, however, there ^ m ^oned above £ performed to correct the density 
are density irregularities on the background due to distor- . , . . . _ , _ , ^. . . . . 
^ , * j . „ . _ irregularity of the optical system and thereby minimize 

dons of the optical system. Hence, by using actually mea- . J . ^ * 4 e ^ 1 . j 

a u-* * Ti7/- ^ ■ « * * • o/. -v - ^ density variations for stable extraction of the background 

s tired white image w(lj) and black image B(ij), an input reo j on 

image ftfj) h conected and converted into an image f (i.j) » qw rf ^gmenmion is detailed 

corrected for distortion. An image f is either red-, green- or ^ ^low 

blue-colored image and (i j) represents the position of a pixel fc aarMb* object region where object particles exist 

in the image. If we let a-reference value of black level be ft, , " . 8 . J . ^"7 ■ ^ c . • .u 

_ , , ? . . . . . . .... . . , „£° from the image of specimen stained by S stain, the region 

and that of white level be cc.. and if the relative value of the ~T7«_.-k-^ t.. .u. .a„,^z1 ~t 

input iir^ef(ij) is to be represented in me a^ segmentation method described below has the advanage of 

of Tp.Tf. *en the distcX-corxected irnagTf (U) canbe * W " * T*' ^ 

.S u e !j Vox u T.Y 55 density variations or color tone variations, 

expressed by Equation (2) shown below. n^e are some known methods to extract object sub- 

(Po- ){/T 1- wr ")> (*) stonccs (particles) in the color space by photographing me 

/(i, j) = tfa i m ^ — image of stained biospecimen. In the urine sediment inspec- 
tion apparatus, however, the object to be extracted by region 

where i=0, 1, 2 510, 511 and j=0, 1. 2 510, 511. 60 segmentation has widely varying properties, as mentioned 

If. the black image B(i.j) is replaced with its average value earlier, and thus the conventional region segmentation 

when the variance of the black image B(i j), after being method cannot be applied as is. 

A/D converted, can be approximated to be below level 1. Studies conducted by the inventor of this invention have 

and if reference is made not to pixels of the white image found that the images obtained with the urine sediment 

W(i j) but to pixels of a white image W(i' j') in a small area. 65 inspection apparatus are normally stable in the background 

the similar correction to the above can be made according to region. Hence, to detect the object particles, this invention 

Equation (3) shown below. first discriminates the background region that exists in stable 
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condition, and then tabes it as a reference. That is. if the (Procedure 6): The binary image generated by (Procedure 

background region can be stably extracted, signal cornpo- 5) is modified and shaped. 

nents representing the object particles to be discriminated (Procedure 7): Mutually independent regions other than 

from the background region are considered to all lie in the background region that was determined by (Procedure 5) 

regions other than the background region. 5 are labeled as object regions where object particles exist. 

The results of measurements of typical sediment particles (Procedure 8): For the labeled object regions, feature 

using a micro-optical densitometer show that the absorption parameters are determined to discriminate the patterns of the 

peak of dye fesat around 550 nm and mat the sensitivity in ob^ct regions^ Known featureparameters are aetenruned by 

to wavelength zone of 500-700 nm (green and red color 8 *™ wn * chm< \™ to we ***** ° f " dm * ual 

4 f . . . . _ . ^ jm («a ,„ , rt object regions. If a pattern corresponding to a pattern 

consents is higher than In the 400-500 nm wavelength .o J^Jg om procedu ^T s generated from object patterns 

zone. This clearly mdicates that m the case of an image of ^ were for color tone discrimination according 

specimen stained by S stain, the region segmentation should tQ &e degree of sVdning of ^ particles and to ob ject 

preferably be performed in the green- and red-colored image particles positions and states (contact and overlapping 

s P aces * conditions), it is possible to obtain a more stable object 

FIG. 4 schematically shows a region segmentation that 15 pattern, 

extracts the background in a color space. An x-axis repre- The process of this embodiment may be summarized as 

sents the density of greencolored image and a y-axis repre- follows. 

sents the density of red-colored image. Here, threshold (1) Gray level correction process: Density irregularities 

values T1.T2 are determined from the density histogram 40 due to distortion of optical system are removed in the 

of redcolored image and threshold values T3. T4 from the 20 green-colored image and red-colored image, 

density histogram 40' of green-colored image. (Although a (2) Region segmentation: By using the threshold values of 

method similar to the region segmentation of FIG. 4 is the green-colored image and red-colored image, the images 

disclosed in Japan Patent Laid-Open No. 314338/1994. it are divided between the background region and the object 

does not make any correction of density irregularities caused region and a binary image is produced with the background 

by distortion of optical system mentioned earlier.) 25 region represented by 0 and the object region represented by 

To describe in more detail, a density histogram is pro- 1. 

duced for each image to determine a density value that has (3) Modifying process: The binary images are modified 

a peak value in the histogram and a density value that gives and shaped, as by swelling the object region and removing 

a half-value width. Next, based on these values, a back- noise from the background region, 

ground region needed to extract the object region is dis- 30 (4) Labeling: Labeling is done for each connected com- 

criminated and picked up. ponent in the binary image to label a plurality of objects in 

Then, the procedure for calculating threshold values. the image with numbers, 

identifying the background and determining feature parara- (5) Calculation of feature parameters: For each of the 

eters of the object particle pattern is explained below. labeled objects, the feature parameters such as area, perim- 

(Procedure 1): A density histogram is generated for each 35 eter and average density are determined, 

image (green-colored image and red-colored image). The (6) Discrimination: Based on the feature parameters 

position of each pixel in the images Is represented by (i,j), obtained, examinations and identifications are made for each 

i.e., G(i j) for pixel in green-colored image and R(ij) for of the objects, 

pixel in red^colored image. The processes (3) to (6) can apply the conventional 

(Procedure 2): In each density histograms density value 40 techniques including filter process such as swelling and 

P/*) that has a maximum value P^(*) of frequency is shrinking process. 

determined as shown in FIG. 5. Application of this embodiment to 99 images produced 

(Procedure 3): In each density histogram, density values from four real samples resulted in extraction of object 

that give a half value of peak arc detennined. particles through region segmentation in 93 images out of 

* represents either red or green. 45 99. The remaining six images in which the object particle 

(Procedure 4): By using the density values Pj(*), Pj^.(*), extraction failed were those found to have non-stained 

determined by (Procedure 1) to (Procedure 3), the object particles and poorly adjusted focus position, 

threshold values Tl, T2. T3. T4 are calculated from the The results of application of this emrxKliment to the actual 

following equations (5) to (8). From the red-colored image, samples (with process (3) implemented) are shown in FIG. 

50 6 and 7. In FIG. 6 and 7, the horizontal (x) axis and vertical 

n^RHPXRH\i(R>} <* (3) (y) axis consists of 5 12 pixels, from 0th to 5 11th pixel FIG. 

TZ^/Ry-iP/Ry-p jtR)}.o (6) 6 shows an example result of region segmentation of an 

image having well-stained cells as object particles, and FIG. 

from green-colored image. 7 shows another example result of region segmentation of an 

55 image having hardly stained cells. According to this 

T3=P4 tov<J - d (GH , «(0)ho (?) crabodiment. when the object particle is not sufficiently 

T4=P j( (OHPi(C>-P d (G)}.<y (8) stained as shown in FIG. 7. the object particle may not be 

completely extracted irrespective of the cytoplasm density 

where a is a redetermined parameter that can be obtained ^ background density. Such poorly stained particles can be 

experimentally and is normally set at 3.0-3 J. ^ extracted by the following methods described in the second. 

(Procedure 5): Based on the threshold values T1-T4 xiM fourth emrxxliment 

calculated by (Procedure 1) to (Procedure 4), a binary image (Embodiment 2) 

is generated in the image space according to Equation (9) fog following, cells (particles) hardly stained by dye are 

shown below. The background region (BG) is obtained from caIlcd nOD -stained cells (particles) and those well stained are 

{ n<R(ioKn]n{TkG(ioKr4) (9) 65 called stained cells ; (particles) for simplicity. Tliose cells 

(particles) stained lightly but only poorly are also called 

where n represents a logical AND. non-stained cells (particles). 
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When the object particles are well stained by dye, a good 
region segmentation can be performed according to the 
method of the first embodiment Cells with high activity 
have a bad stain characteristic and in some cases may hardly 
be stained (non-stained cells). It is found that such non- 5 
stained cells exist in urine specimens highly frequently. 
There are also particles in the urine specimen that are not 
sufficiently stained. 

An image including a non-stained cell has nearly equal 
color tones in the object region and the background region, 1Q 
and the object region includes many parts having densities 
almost equal to or lower than that of the background region. 
When a non-stained cell exists in the image, the region 
segmentation method of the first embodiment can only 
extract the object region to the extent shown in FIG. 7, in 
which the region where the cell exists is not fully filled with 15 
pixels having the same density values. When a correct 
binary image is not obtained* as shown in FIG. 7, it is not 
possible to determine the characteristic parameters of the 
object region correctly and there is a high possibility that the 
identification of the object may fail. To improve the dis- 20 
criminating rate of the sediment components, a method is 
needed which can correctly discriminate objects such as 
cells and particles that can hardly be stained. 

Non-stained cells (cells hardly stained by dye) are almost 
transparent, and the region where the cell exist (object 25 
region) has nearly the same color tone as the background 
region and contains many areas whose densities are almost 
equal to that of the background region. First let us explain 
about the difference between an image including a non- 
stained cell and an image including a stained celt 30 

FIG. 8 and 9 show example densities of images including 
a stained cell and a non-stained celt In FIGS. 8 through 13, 
the abscissa represents the positions of 512 pixels, from Oth 
to 511th pixel in the y direction of the image. 

In an image-including a stained cell (cell that is well 33 
stained), FIG. 8 shows a plotted density along a line (x=300) 
in the y direction passing through a region of the image that 
contains the stained cell. In an image including a non-stained 
cell. FIG. 9 shows a plotted density along a line (x=340) in 
the y direction passing through a region of the image that 40 
contains the non-stained cell. 

In FIG. 8 and 9, the abscissa represents a position in the 
image (y coordinate) and the ordinate represents a density. 
The closer the density is to 0. the darker the color, and the 
closer the density is to 255, the lighter the color. FIG. 8 45 
shows that the green-colored image has its density sharply 
reduced in the region of the stained cell from the background 
region. In this case, if the density is set with a threshold 
value of. say. 180 or 220. it is understood that the green- 
colored image allows the object region and the background so 
region to be clearly divided. (In FIG. 8 the threshold value 
of 190 is also shown for reference.) Comparison between 
FIG. 9 and an actual image (not shown) has found that a cell 
exists in a portion whose density change is larger (at a 
location near y=400) than the surrounding. FIG. 9 Indicates 55 
that in the region (object region) of the non-stained cell there 
are many parts whose densities are higher and lower than 
that of the background region and also many parts whose 
densities are almost equal to that of the background region. 
It is therefore seen that simply setting in FIG. 9 the same 60 
threshold value as used in FIG. 8 does not ensure correct 
extraction of the object region. (In FIG. 9. the same thresh- 
olds as used in FIG. 8 are shown.) 

It is further seen from FIG. 9 that the image containing a 
non-stained cell has large density variations in the non- 65 
stained cell region (object region) while the density variation 
is small in the background region. 
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Utilizing the variations in density, this embodiment cal- 
culates the magnitude of density change in the image, 
provides threshold values to the density and to the magni- 
tude of density change, and performs region segmentation to 
precisely extract the region in the image that contains the 
non-stained cell (the cell hardly stained by dye). 

As an index representing the magnitude of density 
change, let us consider a variance of density in a localized 
area. Suppose the density at a point (x.y) on the image is 
P(x.y) and that a localized variance of density is q(x.y). 
q(x.y) is defined as follows. 

(1 > i=x+nj=y+n ^ (10) 

(2/J+ \y J t=x-nj=y-n 

I — ! — ] ( Wnwl' 

FIG. 10 and 11 show example variances of density in 
images that include a stained cell and a non-stained cell, 
respectively (an example of q(x.y) when n-2). FIG. 10 and 
11 show variance q(x,y) plotted for the same position ( 1 line) 
as in FIG. 8 and 9. respectively. Abscissa represents a y 
coordinate of the image and ordinate represents a variance 
calculated from Equation (10). In FIG. 10 and 11. the large 
peak near y=490 on abscissa is caused by a non-continuous 
component at the end of the image and not related with the 
object to be identified (cell) in the image. FIG. 11 shows 
variance q(x,y) of an image containing a non-stained cell 
Comparison with FIG. 8 shows that the variance of the 
background region is close to zero and the variance of the 
object region is high. Hence, to extract the object region 
containing a non-stained cell, the region segmentation is 
performed by setting a threshold q* for variance and taking 
a region having greater variance than q M as the object 
region. FIG. 11 shows an example with the threshold value 
q* set at 200. 

FIG. 10 shows the variance q(x,y) of an image containing 
a stained cell. Compared with FIG. 8. a large variance is 
found at an edge portion of the object region (near y=200 
and y=300 on abscissa). Because the interior of the cell is 
stained in uniform color tone, variance is small, so that 
performing the region segmentation by setting a variance 
threshold will result in only the edge portion of the cell being 
extracted as the object region (FIG. 10 shows an example 
with the threshold q rt set at 200 as in FIG. 11). To solve this 
problem, the threshold is set not only in the variance but also 
in the density in performing the region segmentation and the 
results of both region segmentation are superimposed to 
correctly extract the object region for a stained cell and the 
object region for a non-stained cell. 

The method described above uses a localized variance of 
density defined by Equation (10) to detect the magnitude of 
density variation in an image. To simplify the construction 
of the apparatus and to allow easier detection of the mag- 
nitude of density variance, a difference in density defined by 
Equation (11) shown below is used. Let the density at point 
(x,y) be P(x,y) and the density difference be r(x.y). 

r=w i=n (11) 

y) = X PU y + 0 - X 4 y - 0 

Because Equation (11) can be calculated by using only 
addition and subtraction and because the density values used 
to calculate a difference value at a point in the image are the 
density values of pixels arranged one-dimensionally on the 
image, it is possible to perform high-speed processing with 
a simple configuration of the apparatus in synchronism with 
the transfer of image signals. 
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FIG. 12 and 13 show examples of density difference 
(when o=2) in images containing a stained cell and a 
non-stained cell, respectively. FIG. 12 and 13 plot density 
difference values for the same positions (one line) as in FIG. 
8 and FIG. 9. respectively. As with the variance, the peak of 
density difference near 490 on abscissa is produced by a 
non-continuous portion at the end of the image. 

FIG. 12 shows the density difference of an image con- 
taining a stained celL Compared with FIG. 8. the density 
difference greatly varies to positive and negative at the edge 
of the object region and. in the object region and in the 
background region, the density difference is close to zero. 

FIG. 13 shows the density difference of an image con- 
taining a non-stained cell. Comparison with FIG. 9 shows 
that the density difference assumes a value close to zero in 
the background region and greatly changes to positive and 
negative in the object region where the cell exist. 

It is noted, however, that there are many parts having 
density difference close to zero even within the object 
region. Therefore, if the region segmentation is performed 
by setting two positive and negative threshold values for the 
density difference r^. ( r i*i <0<r tft2 ) and taking a region 
r^j^x.y)^^ as the background, the areas whose density 
difference is close to zero are treated as the background 
region. Further, if this method is applied to an image 
containing a stained cell, only the edge portion of the cell is 
taken as the object region. FIG. 12 and 13 show the case of 
threshold value i m set to -20 and r^ to 20. 

Here, let us consider the relation between the density and 
the density difference. A point whose density difference is 0 
is where the density assumes a local maximum or local 
minimum value. The density at such a point is very likely to 
assume a value relatively larger or smaller than the density 
value averaged over the background region. That is, for 
areas that cannot be correctly region-segmented based on the 
threshold value of the density difference (areas inside the 
object region that are wrongly recognized as the background 
region), the region segmentation is performed by setting a 
threshold value also for the density to enable correct extrac- 
tion of such areas as the object region. It is therefore possible 
to perform region segmentation correctly both on an image 
containing a non-stained cell and an image containing a 
stained cell by setting threshold values both for the density 
difference and for the density and superimposing the results 
of two region segmentation based on the two threshold 
values (i.e.. taking logical OR). 

This method is explained by referring to the result 
obtained when it was applied to images generated by (he 
flow method. Examination of 51 cases of images containing 
squamous epithelial cells that are very difficult to be stained 
found eight images to have non-stained particles. The appli- 
cation of this method to these eight images, which have 
non-stained particles and were difficult to be correctly 
regionsegmented with the method of the first embodiment, 
produced the similar result to that of the image containing 
stained particles. In the following, we will describe a typical 
case of an image containing a stained particle and a case of 
an image containing a non-stained particle. 

FIG. 14 and 15 show the results of region segmentation 
performed on an image containing a stained cell and an 
image containing a non-stained cell by means of a method 
that uses binarization based on localized variance of density 
(Le., region-segmented binary images that have undergone 
the modifying processes). 

In FIG. 14 to FIG. 17. the horizontal (x) axis and vertical 
(y) axis each consist of 512 pixels, from Oth to 511th pixel. 

The process of region segmentation used the density value 
of green-colored image and the variance that was calculated 
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from Equation (10) by using the density value of green- 
colored image and n=2. That is. let the density at a point 
(x.y) be P(x,y). the variance be q(x.y) and the result of 
binarization be s(x.y). Then, 

5 

s{x, y) = 0 (background: white) (12) 
when P thJ <P(x.y)<P at3 V3d q(* y\ 
six, y) = I (object area: black) 
when other than the above 

10 After determining the binary image represented by s(x.y). 
the modifying processes (background region noise eliminat- 
ing process and object region swell process) were carried 
out, that is. performing the swelling process once and the 
shrinking process two times on the object region, followed 
by one swelling process. (These processes are known 

15 techniques.) 

The threshold values P rtl , P rt2 of density were set as 
follows by determining a density P m that gives the maximum 
value in the density histogram and densities P, 2 . P, 2 
(P fl <P m <P f2 ) that give one-half the maximum value. 

P^*+3-S<P,a-*J (13) 

The threshold of variance is set at q rt =30. 

FIG. 15 clearly shows that the result of region segmen- 
25 tation performed on the image having a non-stained cell is 
greatly improved over the result of Embodiment 1 shown in 
FIG. 7. 

In the image having a stained cell (FIG. 14). germs were 
found at two locations (50. 51) to the right of the object 

30 region; and in the image having a non-stained cell (FIG. 15). 
they were found at one location (52) to the right of the object 
region. These germs were not able to be detected from the 
result of the method of Embodiment 1 (FIG. 6 and 7), There 
are spots at two locations (60. 61) in the image of FIG. 14 

35 on the left side of the object region containing the stained 
cell and also a spot at one location (62) in the image of FIG. 
15 on the left side of the object region containing the 
non-stained cell These spots are smaller than the germs and 
considered noise components of the background region.. 

40 FIG. 16 and 17 show the results of region segmentation 
performed on an image containing a stained cell and an 
image containing a non-stained cell by means of a method 
that uses binarization based on density difference (i.e.. 
region-segmented binary images that have undergone the 

45 modifying processes). The process of region segmentation 
used the density value of green-colored image and the 
density difference that was calculated from Equation (11) by 
using the density value of green-colored image and n=2. 
That is, let the density at a point (x.y) be P(x.y), the density 

50 difference be r(x.y) and the result of binarization be s(x,y). 
Then. 

j(x, y)=0 (background: white) (14) 
when P tk , <Pix,y)<P aa *x* r AJ <rix,y)<r M ; 
55 y) * 1 (<*>§«* area: black) 

when other than the above 

After determining the binary image represented by s(x.y), 
the modifying processes were carried out. The modifying 
processes and the setting of thresholds P fJu . P^ were done 

60 in the same way as in the region segmentation that uses 
binarization based on localized variance of density. The 
thresholds for the difference value tr rtl L tr^l. need be set in 
a range of 15-25. They were set at r rtl =-20 and r^=20. 
FIG. 17 clearly shows that the result of region segmen- 

65 tation performed on the image having a non-stained cell is 
greatly improved over the result of Embodiment 1 shown in 
FIG. 7. 
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In the image having a stained cell (FIG. 16), germs were 
found at two locations (50, 51) to the right of the object w v_*f" » Vk)- t{-*n * 15 * 

region; and in the image having a non-stained cell (FIG, 17), z ~ t=\ 

lheyw« fourth where zT(y) represents the (y-th) power of z (y=k, y=-k). 

region. These germs were not able tobedetected from the 5 ^ ^^^^ at & tirnVis given by 
result of the method of Embodiment 1 (FIG. 6 and 7). ~i j t~ ^ 

Comparison of FIG. 7, 15 and 17 indicates that the above , + * f «n 1 

two kinds of region segmentation method that use bonanza- sin | v 14 ^)" J sin | — j— J 

tion based on localized variance of density and density w(0)=^/ 

difference are more effective than the method of Embodi- 10 
mcnt 1 in extracting the region of a non-stained cell. Of the 
two methods, the one using the localized variance of density where Q represents a space frequency with two pixels on the 
is more effective in the extraction of the non-stained cell image taken as a unit length and j represents an imaginary 
region. The method using the difference of density, however, unit. 

allows the apparatus to be formed in a simpler configuration, is FIG. 20 shows a frequency-amplitude characteristic (IH 
In the following the region segmentation method using (Q)l) for n=l, 2, 3. 

density difference will be described in detail. In FIG. 20, abscissa represents a space frequency with one 

FIG. 16 and 17 show the results obtained by substituting side of the image (512 pixels) taken as a unit length and 
n=2 in Equation (11) that determines the density difference. ordinate represents the filter response normalized by using a 
The number of neighboring pixels used in calculating the 20 m ^ sk slzc - ^ P hase characteristic is constant at n/2. This 
density difference of a certain pixel is expressed as 2n+l. mter has a function of emphasizing a frequency component 
This number is called a mask size. For example, when n=2, uni <l uc . to * c ^ .containing a non-stained cell and 
the determination of the density difference for a pixel seating me einphasize d frequency ^nmonent from the 
requires two pixels on each side of the pixel in question in "jf £° 

^ ,. . ■ , f - . , A1 _ „ degrees to shift from each other a portion that assumes a 

they^ection^ 75 -J^ of Q ^ binarizedb usmgthedensity and a portion 

pixelhas amasksize 5. When the masksize=l. it means that ^ as$ljmcs Q whcn binai ^ d dc J ity tfff£e ncc . 

no (Ufference process is performed. From FIG. 20 it is seen that when n=2 (mask size 5) and 

FIG. 18 shows results of region segmentation with dif- n=3 ^ 7^ mc s jg Dal component in the medium to 

ferent mask sizes. Images shown in FIG. IS each consist of [ ow frequency zone unique to the image containing a 
5 12x5 12 pixels. To examine the effects the mask size has on 30 non-stained cell is intensified but that as the mask size is 
the region segmentation, the value of n was changed in the increased to, say, n=5, the low frequency zone of the signal 
region segmentation. Examples shown in FIG. 18 are results component peculiar to the image containing the non- stained 
of region segmentation performed on the images each con- cell is mitigated, though not shown, For this reason, the 
taining the same non-stained cell as shown in FIG. 7. 15 and appropriate value of n is around 2-4 (mask size 5-9). 
17. The result shown in FIG. 8 for the mask size =5 35 FIG. 21A and 21B show the results of investigation into 
corresponds to the result shown in FIG. 17. In FIG. 18. the the effects that the mask size has on the shape of a region 
result with the mask size =9 represents the best region extracted as an object region from an image of a stained 
segmentation (however, it has white areas within the object blood cell In these figures, the unit of length is the number 
region that were wrongly identified as the background). of pixels. 

As in the results of FIG. 15 and 17, FIG. 18 also reveals 40 Of the objects to be identified, the red blood cell is the 
a cell 52. The result for the mask size =1 that did not perform second smallest next to germs and its shape is almost 
the difference process is similar to the result of Embodiment circular, so that the image of the red blood cell is region- 
1 shown in FIG. 7. segmented by changing the mask size to extract an object 

Next, the effects of the mask size arc examined in terms region and the change in the shape of the extracted object 
of frequency axis. 45 regions is evaluated to check for deterioration mat occurs 

In FIG. 19. a dotted line represents the result of discrete during the image processing (difference between the true 
Fourier transformation performed on a green-colored image shape of an object particle and the shape of the object region 
signal component (density value) on a line (512 pixels) extracted through region segmentation), 
passing through the background region in the y direction. FIG. 21A represents the areas and perimeters of an object 
and a solid line represents the result of discrete Fourier 50 region (red blood cell) when a variety of mask sizes (shown 
transformation performed on a green-colored image signal in the diagram as numbers) are used. As the mask size 
component (density value) on a line (512 pixels) passing increases, the area and perimeter also increase, expanding 
through the object region of a non-stained cell in the y the object region. 

direction. The abscissa represents a space frequency with FIG. 2 IB represents the projection lengths in the x and y 
one side of the image (512 pixels) taken as a unit length, and 35 directions of a region-segmented red blood cell that is 
the ordinate represents a signal power with the maximum projected onto x- and y-axis. Because the red blood cell is 
density value normalized to 0.1. almost circular, when the difference process is not per- 

FIG. 19 indicates that the signals representing the back- formed (mask size =1), its projection lengths on the x- and 
ground region, which are noise components, are distributed y-axis are almost equal. When, however, the difference 
over nearly the entire region with a uniform power except 60 process is performed, the projection length in the y-axis 
far DC components and that the image signals of the line direction, which is the direction of the difference process, is 
passing through the object region of a non-stained cell have larger than the x-axis projection length, making the object 
greater power in the frequency range of 1-150 man the region vertically oblong. As can be seen from FIG. 20. this 
signals of the background region. is because the difference process suppresses the high fre- 

If Equation (11) used to emphasize the object region of a 65 quency components and expands the edge of the object 
non-stained cell is deemed as a digital filter, the transfer which causes the object region to extend in the direction of 
function is expressed as follows by using z-transform. the difference process. 
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This tendency becomes salient as the mask size increases. read out in step S3 are divided into two adjoining regions on 

Hence, the mask size should be determined considering two the image. A summation is taken of densities of pixels 

factors — improvement of segmentation of an image contain- belonging to each region. Next the difference is taken of 

ing a non-stained cell and degradation of segmentation of an these two sums (Equation (21)) or its absolute value is 

image containing a stained cell. 5 determined (Equation (22)). 

The improvement of a binarized image having a non- 
stained cell permits calculation of precise feature parameters *U y) = T { Pf* y + o - y - 0 1 ^ 
and leads to an improved discriminating rate in the pattern 

recognition performed at a later stage. On the other hand, the . ^ . (22) 

degradation of a binarized image having a stained cell makes 10 <fa y) =1 £ { (A* y +■ 0 - y - 0) 
the feature parameters incorrect and adversely affects the 

discriminating rate for small-size objects in particular. The For example, by using density values of four pixels neigh- 
binary image obtained changes according to the threshold boring the pixel (x.y) that were read in step S3. P(x,y-2). 
used in binarization. Generally, the smaller the absolute P(x.y-1). P(x.y+1). P(x,y+2), Equation (21) and Equation 
value of a threshold, the better the region segmentation is 15 C 22 ) ■« calculated to determine q(x,y). 
performed on an image containing a non-stained cell but the 00 A variance of the densities of pixels neighboring the 
more likely it is to pick up noise components in the back- P wc l mat were read in step S3 (Equation (23)) or a 

ground region. This fact must be heeded in detenmning an dc | viatl0n (24)) ls . h d f e ™ Tl ? e 

*: u ia i obtained value is taken to be the magnitude of change in 

optimum threshold value. . 

FIG. 22 is a flow chart showing the procedure of per- 20 utu »"* H^ou» 

forming the region segmentation on a particle image in this ^ ^ (23) 

embodiment. As described above, the particle image to be 4*y)= I \ x x y+y)} 2 - 

processed is stored in an image memory. The image used in I C + r J —nj=-n 

this embodiment is a greencolored image that is represented 1 ^ . * 

by the density value P(x.y) at the position (x.y) of each pixel. 25 { J— - } { 2? *z Pix + i,y+j) J 

According to the steps shown in FIG. 22, the procedure * (2n + iy J l r=^t/*-n ) 

will be explained. r ^ . (24) 

(Step SI): Fust a density value P(x,y) at a pixel (x.y) is Square root | 1 \ r E {/>(*+ iy+j)} 1 - 

rcad from the image memory. L n 

(Step S2): The density value P(x,y) is converted into a 30 1 2 r /=« wt 1 3 1 

variable u(x.y) representing a binary image shown below. { L— . I { i" *T P(x+i, y+» 1 

[ (2n + If J I F*-nj=-n J J 

u(x^)=0 when Tr^x^Kn' (17) 

u(x,y)=i when otherwise (18) where "square root [ ]" means taking the square root of [ ]. 

35 For example, step S3 reads out density values P(ij) for 

where Tl* and T2' represent thresholds and are determined ^ac pixels that meet x-l<i<x+l and y-l<j<y+l and then 

as follows. For example, the density value P(x.y) of an Equation (23) or Equation (24) is calculated to deterniine 

image stored in the image memory is read out to generate the q(x,y), 

histogram of the density value. From the shape of the (c) The density values of pixels neighboring the pixel 
histogram the density thresholds Tl', T2' are detennined ^ (x.y) that were obtained with step S3 are multiplied by 
Normally, die area of the background region on the image is weight values w corresponding to the geometrical arrange- 
largest and thus the average density of the background ment of each pixel. The products thus obtained are summed 
assumes the maximum value on the histogram. As shown in up and this sum is taken as the magnitude of change of 
FIG. 5, the density value P d that gives the maximum value density q(x,y) (Equation 25). 
on the histogram is detected and this niaximum value is 45 

taken as Pmax. Next, density values that give Pmax/2 are y) = ( x" ^ wftj^ + ^y+y) } (25) 

detected and are referred to as P^. P^, (P^^/CP**). I i^-nj=-n f 

By using an appropriate constant k, the thresholds TT.T2' For examp i e , ^ we ight values w(k,m) (k. m— 1, 0, 1) are 

are deterrriined from Equation (19) and Equation (20). md ^ falsity values P(i j) (x-l<o<x+l, y-l<jcy+l) 

Ti'=p^(P -v d (19) 50 f° r nine ptxds ar e read by step S3. Equation (25) is 

* 4 calculated to determine q(x,y). The weight value w may. for 

TT =*s*?»-*<i) (20) example, be w(0,0)=4. w(-1.0)^w(l,0)=w(0,-l>=w(0.1>=l. 

The constant k is determined experimentally beforehand. W (~A' 7^J\ U 9?"* ll "^^H^ ^ n ... 

As shown in Ration (17). whe* TW^l'. * ^^^^ 

pixel (x.y) is deemed as lying in the background region 55 4 i;/ ; / Y J! " • 5 < * • *r^T TT 

^ i 7 /i^rnn. d/ x tv T^ri. • i of the density change thus obtained is taken as the density 

(Equation (17)). When T2'>P(x.y) or P(x.y)>Tl\ the pixel yaluc p . ,f 6 

(x,y) is deemed as lying in the object region (area other than 

the background region, where a particle to be discriminated K*»y)=<i<^y) ( 26 ) 

from the background region exists) (Equation (18)). Then the magnitude of change of density q(x,y) may be 

(Step S3): The density values of a plurality of pixels 60 calculated by one of the above methods (a) to (c). 

neighboring the pixel (x,y) are read from the memory. For example, according to the method (a), the value of 

(Step S4): The magnitude of a change in density (the q(x,y) is determined for all pixels (x.y) and theo Equation 

magnitude of change in density at a pixel (x,y) is represented (26) is applied. Next, by u sing the method (b) the magnitude 

by q(x,y)) is calculated from any of the following methods of density change q(x,y) is calculated again, 

(a) to (d). 65 (Step S5): The magnitude of change of density q(x,y) is 

(a) As shown in Equation (21) or Equation (22). the converted into a variable v(x.y) shown below representing 

density values of pixels neighboring the pixel (x,y) that were the binary image. 
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When q(x,y) takes only a positive value, the threshold T3' FIG. 24 shows the configuration of the region segmenta- 
ls used. tion unit 106 of FIG. 23. An input unit 200 is connected to 

v(x,y>=0 when ^yyTJ (27) ^ ^ bUS 110 ° f nG * 23 and COntrols ^ in P ul of ^ 

through the data bus 110. A density binarization circuit 300 

v(i,y>=l when qfcypTS (28) 3 reads the thresholds Tl\ TZ from the threshold calculating 

When q(x,y)<T3\ the pixel (x.y) is deemed as lying in the unit 105 ^ M > ti* 011 ^ toe "V*" 200 and * e 

background region (Equation (27)). When q(x,y)>T3\ the thresholds IT. T2' in a threshold memory 310. Next a 

pixel (x.y) is deemed to exist in the object region (Equation density value of one pixel on the image is read from the 

(28)). The threshold T3\ can be determined experimentally image memory 104 through the input unit 200 and is 

beforehand. compared with the thresholds Tl\ T2' by a comparator 320. 

When q(x,y) takes a negative value, too. (step SS') uses Let the position of a pixel on the image be (x.y) and the 

threshold T3" and threshold T4\ density far that pixel be F(x,y). The comparator 320 com- 

v(x^M) when TO**FXir (29) ^ te dCnSit * ValUC thrcsholds T1 '« T2 ' * 

^ y 1 ' l5 it finds that T2<P(x.y)<Tr, the comparator 320 regards its 

Y<x,yM when other than the above (30) p^ei as lying in the background region and output 0. When 

When T4'<q(x,yKT3". the pixel (x.y) is regarded as existing *e density is other than the above, the comparator 320 

in the background region (Equation (29)). When T4'>q(x.y) outputs 1 indicating that the pixel exists in the object region, 

or q(x,y)>T3\ the pixel (x.y) is regarded as existing in the In parallel with the density binarization described above, 

object region (Equation (30)). The threshold T3 N and thresh- 20 a density change binarization circuit 400 is activated. The 

old T4' can be determined experimentally beforehand. density change binarization circuit 400 reads density values 

(Step S4 f ): Selection of S5 and S5' is automatically of a plurality of pixels neighboring the pixel (x.y) on the 

determined according to how q(x.y) is defined in (step S4). image from the image memory 104 through the input unit 

(Step S6): Logical OR is taken of u from (step S2) and v 200. and stores the density values in a memory 410. A 

from (step SS) or (step SS') and is regarded as the result of 25 density change calculation unit 420 calculates a change of 

binarization for pixel (x,y). density according to one of the following methods (a) to (d) 

(Step S7. S8): If the pixel (x,y) is the last pixel to be by using the density values of the pixels neighboring the 

processed, the processing moves to step S9. If not, the pixel pixel (x.y) stored in the memory 410. The magnitude of 

(x.y) is moved to the next pixel where the steps S 1 to S6 arc change of density at the pixel (x.y) is represented by q(x.y). 

repeated (step S7, S8). 30 ( a ) The pixel density values stored in the memory 410 are 

(Step S9): The binary image, in which the object region is grouped into two adjoining regions of the image. Density 

represented by 1 and the background region by 0, is sub- values are summed up for the pixels belonging to each 

jected to modifying processes such as an object region region. Next, the difference of these two sums or its absolute 

swelling process and a background region noise elirninating value is determined and is taken to be q(x,y). For example, 

process. « density values of four pixels P(x.y-2), P(x,y-l), P(x.y+1), 

(Step S10): For each connected component of the binary P(x.y+2) are stored in the memory 410 and Equation (31) or 

image, the labeling process using a known technique is Equation (32) is calculated to determine q(x.y). 
performed to number a plurality of objects in the image. 

(Step Sll): For each numbered objects, feature param- i=2 r=2 (3i> 

eters such as area, perimeter, average density and projection 40 ^ y) = ^ p ^ y +f >-ij*(*>-0 
length are determined. 

(Step S12): By using the feature parameters thus obtained, ^ y) J y + ^ _ ^ 2 P{Xt y _ ^ I C32) 

the objects are classified into one of the urine sediment I »=i *=i 1 
components. 

FIG. 23 shows the configuration of an apparatus for 45 nG - 25 *"™* m cxanmlc configuration of the density 

implementing this enfcodiment A particle in the liquid is **** Wiwtata «400. The memory 410 consists of 

iUuminated with a pulse lamp 10L magnified by an optical four mcmones 4U ^ 14 ^ stonn S one dcnsit y value ' ^ 

magnification system (not shown), photographed byTrV t^^^^J^^)^^ ***+ 2) " 

camera 102 and then converted into an analog electric stored * me memorics 411 " 414 respectively. 

signaL The output of the TV camera 102 is converted by an 50 The density change calculation unit 420 includes two 

A/D converter 103 into a digital signaL which is transferred adders 421, 422 and one subtracter 423 and performs 

through a data bus 110 into an image memory 104 where it calculation defined by Equation (31). The output of die 

is stored. A threshold calculating unit 105 reads, via the data adder 421 represents a value calculated by the second term 

bus 110. density values of the image stored in the image of tiie right-hand side of Equation (31). and the adder 422 

memory 104 to generate a histogram of the density value 55 outputs a value calculated by the first term on the right-hand 

and. from the shape of the histogram, determine the thresh- sidc of Equation (31). The subtracter 423 outputs a value 

oldslT.TT used in a region segmentation unit 106 accord- calculated by the right-hand member of Equation (31). 

ing to Equation (19) and Equation (20). When ^ subtracter 423 is provided with a function to 

The region segmentation unit 106 performs region seg- output an absolute value, the calculation defined by Equa- 

mentation based on the density values read from the image 60 ( 32 ) can performed. 

memory 104 through data bus 110 and on the thresholds TV. (b) Variance, or standard deviation, of densities stored in 

T2' obtained from the threshold calculating unit 105. per- the memory 410 is determined and is taken as the magnitude 

forms binarizatioiLto represent the object region with 1 and of change of density q(x.y). For example, density values 

the background region with 0. and then stores, the result of P(i j) of nine pixels that satisfies the conditions of 

binarization in an image memory 107 through data bus 110. 65 x-l<i<x+l and y-l<y+l are stored in the memory 410. The 

This series of processing is controlled by a computer 108 magnitude of change of density q(x,y) is calculated from the 

through a CPU bus 109. following equations (33) or (34). 
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[I i=l J=l ^ (34) 

where "square root [ 1" means taking the square root of [ ]. 

FIG. 26 shows an example circuit configuration of the 
memory 410 and the density change calculation unit 420. 
The memory 410 consists of nine memories 811-819 each 
storing one density value. Density values P(i.j) of nine pixels 
that meet the conditions of x-l<i<x+l and y-l<j<y+l are 
stored in these memories 811-819. The density change 
calculation unit 420 includes a square calculation unit 821 
consisting of nine square calculators, adders 822, 824, 
dividers 823. 825. a square calculator 826 and a 827 sub- 
tracter 827. The values read from the memories 811-819 are 
each divided in two. one being entered into the square 
calculating unit 821 and the other into the adder 824. The 
adder 822 calculates the sum of the outputs of nine square 
calculators 821 and the sum produced by the adder 822 is 
divided by 9 with the divider 823. The divider 823 outputs 
a value calculated by the first term on the right-hand side of 
Equation (33). 

The adder 824 calculates the sum of nine density values 
read from the memories 811-819. and the output of the 
adder 824 is divided by 9 with the divider 825. The square 
calculator 826 outputs a value calculated by the second term 
on the xight-hand side of Equation (33). The subtracter 827 
calculates a difference between the output of the divider 823 
and the output of the square calculator 826. The subtracter 
827 outputs a value calculated by the right-hand member of 
Equation (33). If a circuit for calculating a square root is 
provided after the subtracter 827. it is possible to output a 
value calculated by the righthand member of Equation (34). 

(c) The density values of pixels stored in the memory 410 
are multiplied with weight values w corresponding to the 
geometrical positions of the pixels on the image, and the 
summation of these products is taken to be the magnitude of 
change of density q(x,y). For example, nine weight values 
w(kjn) (k, m=>-l. 0. 1) are set beforehand and the density 
values for nine pixels P(Lj) (x-l<i<x+l, y-lj<y+l) are 
saved in the memory 410. Then q(x,y) is calculated accord- 
ing to Equation (35). 

1t=l >=1 1 (35) 

The weight values may be w(0.0)=-4, w(-1.0>=w(L0) 
=w(0.- 1 )=w(0. 1 >= i . w(- 1 1) w(-U)=w(l -1) =w(U)=a 
FIG. 27 shows an example circuit configuration of the 
memory 410 and the density change calculation unit 420. 
The memory 410 consists of nine memories 931-939 each 
storing one density value. The density values F(x-l,y-l), 
P(x,y-1), P(x+l.y-l). P(x-l.y). P(x.y), P(x+loO. F(x-l,y+l), 
P(x.y+1), P(x+l.y+l) are stored in the memories 931-939 
respectively. The weight value memories 941-949 are preset 
with weight values w(-l,-l), w(0.-l), w(l,-l), w(-1.0). 
w(0.0). w(1.0). w(-l,l). w(0.1) and w(l.l). The multipliers 
951-959 calculates the products of density values and 
weight values and the adder 961 sums up nine products. 
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(d) According to one of the above methods (a) to (c). the 
magnitude of change of density is determined. This magni- 
tude of change of density is deemed as a density value, and 
then the magnitude of change of density is again calculated 
5 according to one of the methods (a) to (c). The value thus 
obtained may be taken to be q(x.y). 

For example, the value of q(x.y) is calculated for all pixels 
(512x512 pixels, for instance) according to the above 
method (c). By substituting q(x.y) as follows. 

10 Pfx^fcy) (36) 

the method (b) is used to calculate q(x,y) again. In this case, 
the memory 410 and the density change calculation unit 420 
can be replaced with a density change calculation unit whose 
circuit configuration is shown in FIG. 28. 

15 First, a weighted sum calculation unit 900 calculates the 
right-hand member of Equation (35) for all pixels and stores 
the values obtained in an image memory 1000. Next, a 
variance calculation unit 800 calculates the right-hand mem- 
ber of Equation (33) by taking the values stored in the image 

20 memory 1000 as density values and then outputs the calcu- 
lated value. The configurations of the weighted sum calcu- 
lation unit 900 and the variance calculation unit 800 are 
shown in FIG. 27 and FIG. 26, respectively. 
The comparator 430 of FIG. 24 consists of a threshold 

25 memory 431 and a comparator 432 as shown in FIG. 25. The 
thresholds T3' or T3". T4' are stored in the threshold memory 
431 beforehand. If the magnitude of change of density q(x.y) 
assumes only a positive value, when q(x,y)<T3\ the pixel in 
question is considered to exist in the background region and 

30 0 is output. When q(x.y) is other than the above, the pixel is 
assumed to exist in the object region and 1 is output 

If q(x.y) takes a negative value, too. and when T4'<q(x, 
y)<03 w . 0 is output. When q(x,y) takes other values. 1 is 
output The thresholds T3\ T3\ T4' can be experimentally 

35 determined beforehand. Next, a logical OR circuit 500 takes 
a logical OR of the output from the density binarization 
circuit 300 and the output from the density change binariza- 
tion circuit 400. The above processing is performed for all 
pixels to produce a binary image with the object region 

40 represented by 1 and the background region represented by 
0. The binary image generated in this manner is filtered by 
a filter unit 600 whereby the object region is swelled and the 
background region is shrunk to eliminate background noise. 
The binary image thus modified is output onto the data bus 

45 110 from the output unit 700 (FIG. 24). 

The process of this embodiment may be summarized as 
follows. 

(1) Density correction process: In the greencolored image, 
density irregularities resulting from distortion of the optical 

50 system are removed. 

(2) Region segmentation: The green-colored image is 
region-segmented based on quantities representing density 
and change of density to generate a binary image whose 
background region is represented by 0 and object region is 

55 represented by 1. 

(3) Modifying process: The binary image is subjected to 
the modifying and shaping process whereby the object 
region is swelled and background noise is eliminated. 

(4) Labeling: Each connected component in the binary 
60 image is labeled to number a plurality of objects in the 

image. 

(5) DeterrDining feature parameters: For each numbered 
object, the feature parameters including area, perimeter and 
average density are determined. 

65 (6) Identification: Based on the feature parameters, check 
is made to identify what urine sediment component each 
object is. 
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The processes (3) to (6) may use known conventional 
techniques including swelling and shrinking process. 
(Embodiment 3) 

This embodiment uses the configuration of the first 
embodiment (region segmentation is performed by setting 
thresholds of density in green-colored image and red- 
colored image) instead of using the configuration of the 
second embodiment in which the region segmentation is 
done by setting a threshold of density in the green-colored 
image. 

Results of region segmentation processes applied to many 
samples have found mat the method of region segmentation 
of the first embodiment can extract stained cells more 
correctly than non-stained cells and that the method of the 
second embodiment because it uses only a green-colored 
image, extracts the stained cells not as clearly as the first 
embodiment when the green-colored image of the stained 
particles is blurred. In this ernbodiment, because thresholds 
are set for the density of green-colored image and red- 
colored image, the region segmentation can use the infor- 
mation of the red-colored image when the greencolored 
image is not clear, making it possible to extract the object 
particle more precisely than in the first and second embodi- 
ment 

The processes of this embodiment may be summarized as 
follows. 

(1) Density correction process: In the greencolored image 
and the red-colored image, density irregularities resulting 
from distortion of the optical system are removed. 

(2) Region segmentation: In the green-colored image and 
the red-colored image, a plurality of thresholds are used for 
region segmentation to generate binary images with the 
background region represented by 0 and the object region 
represented by 1. 

(3) Region segmentation: Based on quantities represent- 
ing density change in the green-colored image, the green- 
colored image is region-segmented to generate a binary 
image with the background region represented by 0 and the 
object region represented by 1. 

(4) Region segmentation: Logical OR is taken of the 
binary images obtained in (2) and (3). 

(5) Modifying process: The binary image is subjected to 
the modifying and shaping process whereby the object 
region is swelled and background noise is eliminated. 

(6) Labeling: Each connected component in the binary 
image is labeled to number a plurality of objects in the 
image. 

(7) Detennining feature parameters: For each numbered 
object, the feature parameters including area, perimeter and 
average density are determined 

(8) Identification: Based on the feature parameters, check 
is made to identify what urine sediment component each 
object is. 

Processes (5) and (6) may use known conventional tech- 
niques including the filter process such as swelling and 
shrinking. Further, the process (5) may be performed on the 
result of (2) and (3) and instead the process (5) may be 
omitted. 

Whichever of the region segmentation (2) and (3) may 
come first Alternatively, they may be performed paraileUy. 

From a red component image (red-colored image), a green 
component image (green-colored image) and a blue com- 
ponent image (blue-colored image) of an object particle, the 
red component image (red-colored image) and the green 
component image (green-colored image) are selected as in 
the first ernbodiment Further, as in the second embodiment 
the green component image (green-colored image) is 
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selected and the configuration of the first embodiment is 
incorporated into a part of the configuration of the second 
embodiment. Region segmentation was performed on the 
same 51 images that were used in the second emrx>dimcnt 
s and which contain squamous epithelial cells that are most 
likely not to be stained. In all 51 images including eight 
images having non-stained particles, a good region segmen- 
tation result was obtained. That is. with the configuration of 
the first embodiment incorporated into a pan of the con- 
10 figuration of the second embodiment a good region seg- 
mentation was able to be carried out which could not be 
obtained with the single method of the first or second 
embodiment This combined method makes it possible to 
region-segment as one connected object region almost all 
object particles including,non-stained cells that were diffi- 
15 cult to region-segment ideally as one region with a single 
method. This combined method therefore improves the 
precision of aiscriimnating the sediment components. 

This embodiment can discriminate the background region 
correctly and extract individual object regions stably, pro- 
20 during more precise binary images even when the image 
contain a mixture of well- stained particles and particles 
difficult to stain when specimens arc stained (including 
particles not stained well and those hardly stained). As a 
result, the feature parameters of the object regions can be 
25 determined more precisely and erroneous discrimination of 
object particles minimized Therefore, even when a speci- 
men includes a mixture of object particles having differing 
stained levels and objects with bad stain characteristic which 
are hardly stained, precise region segmentation can be 
M performed for each object particle, improving the discrimi- 
nation of a variety of kinds of sedimentation components. 

FIG. 30 and 31 show the results of region segmentation of 
this ernbodiment performed on actual specimens. The speci- 
men of FIG. 30 is the same as shown in FIG. 6. 14 and 16 
and is an example of a well-stained cell (stained cell). The 
35 specimen of FIG. 31 is the same as shown in FIG. 7, 15 and 
17 and is an example of a poorly stained cell (non-stained 
cell). 

In FIG. 30 and 31, binary images 251. 261 represent the 
results of the region segmentation according to the method 

40 that sets thresholds in the density value for the green-colored 
image and the red-colored image of the first embodimtnt. 
Binary images 252, 262 represent the results of the region 
segmentation according to the method that sets thresholds in 
quantity representing a change of density value for the 

43 green-colored image of the second embodiment (by using 
difference value for n=£). A binary image 253 is the result of 
logical OR of the binary images 251 and 252. A binary 
image 263 is the result of logical OR of the binary images 
261 and 262. These region-segmented binary images 251, 

so 261, 252. 262. 253, 263 are not subjected to the modifying 
process (correction and shaping processes, such as swelling 
of object region and elimination of background noise). 
Binary images 254. 264 are the binary images 253. 263 that 
have undergone the modifying process. Performing the 

55 modifying process on the binary image 251 produces an 
image of FIG. 6; and performing the modifying process on 
the binary image 261 produces an image of FIG. 7. 

The method of the third embodiment can extract particles 
in the image leaving almost no particles undetected when it 

60 is difficult for a single method of the first or second embodi- 
ment to extract particles in the specimen. 
(Embodiment 4) 

This embodiment takes logical OR of two or three of the 
binary images produced by the region segmentation method 
65 according to Embodiment 1 to Embodiment 3 to generate a 
new binary image, thereby extracting object particles more 
precisely. 
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FIG. 29 schematically explains about the method of this This invention utilizes such small changes of density in 
embodiment, which combines two binary images that were cell images according to locations. That is. the region 
region-segmented by two different methods (based on the segmentation of this invention involves calculating the 
first and second embodiment). The binary image 210 gen- quantity that represents a change in density at each point on 
erated by the region- segmentation method of the first 5 the image and setting thresholds in the density value and in 
embodiment and the binary image 220 generated from the the quantity representing a change of density. This method 
quantity representing the change of density in the green- allows correct region segmentation even when object par- 
colored image by the method of the second embodiment are tides are not well stained, 
combined to generate a new binary image 230. This syn- (Embodiment 5) 

thesized image is obtained by taking logical OR of the above By referring to FIG. 32. apparatuses for extracting particle 
two binary images 210 and 220. A particle image 212 in the images that apply the methods of the first to fourth embodi- 
binary image 210 picks up only a part of the periphery of the ment arc described in the following, 
particle image 222 detected in the binary image 220. Image signals of a specified photograph region in the 
Conversely, a particle image 221 in the binary image 220 green-colored image, red-colored image and bluecolored 
picks up only a part of the interior of the particle image 211 image from the TV camera 102 are converted into digital 
found in the binary image 210 (a part of the interior of the 15 image data for 512x512 pixels by the A/D converter 103. 
particle image 211 is identified as the background region). For each pixel of the image data, the following processes are 
The new binary image 230, which is synthesized by performed to distinguish between a region where particles 
taking logical OR of the two binary images 210 and 220. exist and a background region and generate a region- 
reveals particle images 231. 232. In this way. this method segmented binary image. 

compensates for the drawbacks of the region segmentation 20 A density correction circuit 72 corrects density irregulari- 

methods of the preceding embodiments and produces a ties according to Equation (2) or Equation (3) by using data 

binary image with improved quality mat extracts object stored in a correction data memory 70 for correcting density 

particles more precisely. While the above description uses irregularities resulting from distortion of the imaging optical 

logical OR as a means of synthesizing, other logical opera- system. The result of correction is stored in the image 

tions may be appropriately selected depending on the pro- 25 memory 90. The above configuration is common to the 

cess conditions of a specimen to be image-processed (stain apparatuses that implement the first to third embodiment 
conditions), the kind of specimen and the kind of object Example apparatuses that implement the first to fourth 

particles. embodiment are described below. 

Which of the red-colored image, green-colored image and (a) The apparatus that implements the first embodiment 

blue-colored image should be used for region segmentation 30 includes, of the configuration shown in FIG. 32, a histogram 

shall be determined for each of the region segmentation calculation circuit 74. a threshold calculation circuit 76, a 

methods of the preceding embodiments, by taking into density binarization circuit 78 and a binary image memory 

consideration optical characteristic of a specimen to be 80. The histogram calculation circuit 74 generates histo- 

analyzed and levels and variations of a signal representing a grams for the green-colored image and red-colored image by 

background region and a signal representing an object 35 using the red- and green-colored image data whose density 

region where object particles exist Although logical OR is irregularities were corrected by the density correction circuit 

adopted as a logical operation for the region segmentation to 72. The threshold calculation circuit 76 calculates thresholds 

extract the object particles, any other appropriate logical Tl, T2, T3. T4 according to Equation (5) through Equation 

operation may be used depending on the process conditions (8). The density binarization circuit 78 detects the back- 

of a specimen to be image-processed (stain conditions), the 40 ground region from the green- and red-colored image data 

kind of specimen and the kind of object particles. according to Equation (9) by using the thresholds Tl, T2. 

A stain is usually added to a urine specimen to dye cells T3, T4. binarizes the image data and then stores the binary 
of sediment components normally in blue, red or purplish image data in a binary image memory 80. In the apparatus 
red. The conventional region segmentation methods utilize for the first embodiment the density binarization circuit 78 
the color difference between background, which is normally 45 and the binary image memory 80 serve a binarization circuit 
white, and the sediment components, set thresholds in image 96 and a binary image memory 98. respectively, 
signals for each of the red-colored image, green-colored (b) The apparatus that implements the second embodi- 
image and blue-colored image and takes the white area as ment includes, of the configuration shown in FIG. 32, a 
the background region and other areas as object regions density change binarization circuit 92 that detects the mag- 
where object particles exist Such conventional methods. 50 nitude of change of density between pixels in the green- 
however, cannot correctly detect particles that failed to be colored image data read from the image memory 90 whose 
stained well. This is because, of the precipitated cells, those density irregularities were corrected; a binary image 
with high activity, which are not completely dead, have a memory 94 that stores the result of density change binariza- 
tendency of not absorbing dye and remain unstained or tion operation; a histogram calculation circuit 74 that uses 
transparent and the regions where cells exist have almost the 55 the greencolored image data of the red- and green-colored 
same color tone as the background region. Hence, cell image data whose density irregularities were corrected as 
regions cannot be extracted correctly by the conventional explained in (a); a threshold calculation circuit 76; a density 
simple region segmentation method. binarization circuit 78; and a binary image memory 80. The 

Cells not well stained are colorless and transparent and configuration of the density change binarization circuit 92 is 

the interior or surface of the cells has uneven characteristics 60 similar to the ones shown in FIG. 25. 26, 27 and 28 that were 

that cause refraction and diffusion of light, resulting in a described in detail in connection with the second embodi- 

large change in density value in the region of the image ment The binarization circuit 96 takes logical OR of data 

where the cells exist With the simple region segmentation stored in the binary image memory 80 and data in the binary 

method, the region where only one cell exists appears image memory 94 to perform region segmentation and then 

divided in smaller regions, which are wrongly identified as 65 stores the result in the binary image memory 98. 
different discrete sediment components, lowering the dis- The process involving the histogram calculation circuit 

criminating rate. 74, threshold calculation circuit 76 and density binarization 
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circuit 78 is performed in parallel with the process of the 
density change binarization circuit 92 and can be increased 
in speed. 

In the above, we have described a case where density 
values of the green-colored image and red-colored image 3 
data are used. The configuration is not limited to this and the 
two kinds of image data used may appropriately be selected 
from among the red-, green- and blue-colored image data. 
By using the selected image data, the threshold calculation 
circuit 76 calculates a plurality of thresholds and the density 10 
binarization circuit 7ft stores the binarized image data in the 
binary image memory 80. 

In the above, we have described the configuration of the 
density change binarization circuit 92 that detects the mag- 
nitude of change of density between pixels in the green- is 
colored image data and of the binary image memory 94 that 
stores the result detected. Other configuration may be used. 
For example, one or two more circuits consisting of the 
density change binarization circuit 92 and the binary image 
memory 94 may be connected in parallel to parallelly detect 20 
the magnitude of change of density between pixels in one 
image data-blue- or red-colored image data-or in two image 
data-blue- and red-colored image data-in addition to the 
green-colored image data. The binarization circuit 96 may 
then perform logic operation, such as logical OR, on the 25 
images that were detected by the parallel density change 
binarization circuits 92 and stored in the plurality of binary 
image memories 94 and on the images stored in the binary 
image memory 80. The resulting binary image may be stored 
in the binary image memory 98. 30 

Because this configuration generates the binary image 
data by using a plurality of images from among the red-, 
green- and blue-colored image data and detecting the mag- 
nitude of change of density between pixels in each of the 
images, it is possible to discriminate particle regions where 35 
particles exist more accurately than when the binary image 
data is obtained by using a single image from among the 
red-, green- and blue-colored image data and detecting the 
magnitude of change of density between pixels in the 
selected image. 40 

(c) The apparatus that implements the third embodiment 
has the configuration shown in FIG. 32. That is, it has a 
combined configuration of (a) and (b). In more detail, this 
apparatus includes a density change binarizatioo circuit 92, 
which detects the magnitude of change of density between 45 
pixels in a green-colored image data- which was read from 
the image memory 90 and whose density irregularities were 
corrected-and generates a binary image data; a binary image 
memory 94 to store the binary image data; a histogram 
calculation circuit 74, which generates histograms of the 50 
green- and red-colored images by using the red- and green- 
colored image data whose density irregularities were cor- 
rected; a density binarization circuit 78. which, by using the 
thresholds Tl, T2. T3, T4, detects the background region 
from the green- and red-colored Image data according to 55 
Equation (9) to produce binary image data; a binary image 
memory 80 to store the binary image data; a binarization 
circuit 96 that takes logical OR of the data stored in the 
binary image memory 80 and the data in the binary image 
memory 94; and a binary image memory 98 that stores the 60 
result of logical OR operation, i.e., the result of region 
segmentation. The configuration of the density change bina- 
rization circuit 92 has already been detailed in connection 
with the second embodiment and is similar to the ones 
shown in FIG. 25, 26. 27 and 28. 65 

The process involving the histogram calculation circuit 
74. threshold calculation circuit 76 and density binarization 
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circuit 78 is performed in parallel with the process of the 
density change binarization circuit 92 and can be increased 
in speed. 

In the above, we have described a case where density 
values of the green-colored image and redcolored image 
data are used. The configuration is not limited to this and the 
two kinds of image data used may appropriately be selected 
from among the red-, green- and blue-colored image data. 
By using the selected image data, the threshold calculation 
circuit 76 calculates a plurality of thresholds and the density 
binarization circuit 78 stores the binarized image data in the 
binary image memory 80. Further, a plurality of circuits, 
each consisting of the histogram calculation circuit 74. the 
threshold calculation circuit 76. the density binarization 
circuit 78 and the binary image memory 80. may be con- 
nected in parallel. Density values of. say. greenand blue- 
colored image data may be used in addition to the density 
values of green- and red-colored image data, and binary 
images from these image data may be stored in the plurality 
of binary image memories 80. The binarization circuit 96 
may then perform logic operation, such as logical OR. on the 
image stored in the binary image memory 80 and on the 
images stored in the plurality of binary image memories 80. 
The resulting binary image may be stored in the binary 
image memory 98. 

While in the above we have explained about the configu- 
ration of the density change binarization circuit 92 that 
detects the magnitude of density change between pixels in. 
the green-colored image data and of the binary image 
memory 94 that stores the detected result, other configura- 
tion may be employed. For example, one or two more 
circuits consisting of the density change binarization circuit 
92 and the binary image memory 94 may be connected in 
parallel to parallelly detect the magnitude of change of 
density between pixels in one image data-blue- or red- 
colored image data-or in two image data-blue- and redcol- 
ored image data-in addition to the green-colored image data. 
The binarization circuit 96 may then perform logic 
operation, such as logical OR. on the images that were 
detected by the parallel density change binarization circuits 
92 and stored in the plurality of binary image memories 94 
and on the images stored in one or more binary image 
memories 80. The resulting binary image may be stored in 
the binary image memory 98. 

Because this configuration generates the binary image 
data by using a plurality of images from among the red-, 
green- and blue-colored image data and detecting the mag- 
nitude of change of density between pixels in each of the 
images, it is possible to discriminate particle regions where 
particles exist more accurately than when the binary image 
data is obtained by using a single image from among the 
red-, green- and blue-colored image data and detecting the 
magnitude of change of density between pixels in the 
selected image. 

(d) The apparatus that implements the fourth embodiment 
has a configuration described in (a) and (b) and performs by 
the binarization circuit 96 the logical OR on the results 
obtained in the configurations of (a) and (b) to produce a 
regionsegmented binary image, which is then stored in the 
binary image memory 98. 

By using the region-segmented binary images stored in 
the binary image memories 98 in the configurations (a) to 
(d). feature parameters associated with the object regions 
where particles exist are determined by the computation 
means (not shown in FIG. 32) to discriminate the urine 
sediment particles. 
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We claim: 

1. A region segmentation method for particle images 
comprising: 

photographing and storing as static images a red compo- 
nent image (red-colored image), a green component 
image (green-colored image) and a blue component 
image (blue-colored image) of stained and non-stained 
object particles supplied through an image input optical 
system; 

a first process of setting a first group of thresholds in 
density value for a first group of two or more images 
selected from the red-colored image, green-colored 
image and blue-colored image to discriminate between 
a background region and object regions where the 
object particles exist, and to extract the object regions 
differing in density from the background region, and 
producing a first binary image from the first group of 
two or more images, wherein the first group of thresh- 
olds are low thresholds and high thresholds in density 
value and the first group of thresholds are set for the 
two or more images of the first group and density 
values of pixels of the extracted object regions are 
lower than the low thresholds or higher than die high 
thresholds in the two or more images of the first group; 

a second process of calculating for each pixel a quantity 
representing the magnitude of change of density in an 
area neighboring each of the pixels making up a single 
image selected from the first group of images, compar- 
ing a change of density in the background region with 
the quantity representing the magnitude of change of 
density calculated for each pixel, setting a second 
group of thresholds for extracting object regions whose 
change of density is larger than that of the background 
region, and producing a second binary image from the 
single image; and 

a third process of performing a logic operation on the first 
binary image and the second binary image to produce 
a third binary image showing the background region 
and the object regions. 

2. A region segmentation method for particle images 
according to claim 1. wherein the particle images are images 
of stained and non-stained urine sediment particles scattered 
in a flow. 

3. A region segmentation method for particle images 
according to claim 1. wherein, prior to the first and second 
process, using a white image photographed when an object 
has a uniform and infinitely small light absorption and a 
black image photographed when an object has an infinitely 
large light absorption, density irregularities which are 
caused by distortion of the image input optical system and 
which are present in the first group of images are corrected. 

4. A region segmentation method for particle images 
according to claim 1. wherein the first group of images is the 
green-colored image and the redcolored image, and the 
single image is the green-colored image. 

5. A region segmentation method for particle images 
according to claim 1. wherein at least a portion of the first 
process and the second process are parallelly executed. 

6. A region segmentation method for particle images 
according to claim 1. wherein the first process and the 
second process are parallelly executed. 

7. A region segmentation method for particle images 
according to claim 1, wherein the logic operation is a logical 
OR. 

8. A region segmentation method for particle images 
according to claim 1. wherein either a difference between 
sums of density values of pixels contained in each of two 
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small areas neighboring each of the pixels, or an absolute 
value of the difference between the density sums is taken as 
the quantity representing the magnitude of change of den- 
sity. 

5 9. A region segmentation method for particle images 
according to claim 8, wherein the small areas have a size of 
two to four pixels arranged onedimensionally in a specified 
direction in the single image. 

10. A region segmentation method for particle images 

1Q according to claim 1. wherein either a weighted sum of the 
density values of pixels in the small area neighboring each 
of the pixels or an absolute value of the weighted sum is 
taken as the quantity representing the magnitude of change 
of density. 

j 3 11. A region segmentation method for particle images 
according to claim 10. wherein the small area has size of two 
to four pixels in a specified directions in the single image. 

12. A region segmentation method for particle images 
according to claim 1. wherein either a variance or a standard 

20 deviation of distribution of density of pixels in the small 
areas neighboring each of the pixels is taken as the quantity 
representing the magnitude of change of density. 

13. A region segmentation method for particle images 
according to claim 1. wherein the first process comprises a 

25 step of generating a density histogram for each of images of 
the first group of images to determine the low and high 
thresholds, wherein the low thresholds are lower than a 
maximum density value of the density histogram, and the 
high thresholds are higher than the maximum density value 

30 of the density histogram 

14. A region segmentation method for particle images 
comprising: 

photographing and storing as static images a red compo- 
nent image (red-colored image), a green component 

35 image (green-colored image) and a blue component 
image (blue-colored image) of stained and non-stained 
object particles supplied through an image input optical 
system; a first process of correcting density irregulari- 
ties present in a first group of two or more images 

40 selected from the red-colored image, green-colored 
image and blue-colored image using a while image 
photographed when an object has a uniform and infi- 
nitely small light absorption and a black image photo- 
graphed when an object has an infinitely large light 

45 absorption, the density irregularities being caused by 
distortion of the image input optical system; 
a second process of setting a first group of thresholds in 
density value for the first group of two or more images 
to discriminate between a background region and 

50 object regions where the object particles exist and to 
extract the object regions differing in density from the 
background region, and producing a first binary image 
from the first group of images, wherein the first group 
of thresholds arc low thresholds and high thresholds in 

55 density value and the first group of thresholds are set 
for the two or more images of the first group, and 
density values of pixels of the extracted object regions 
are lower than the low thresholds or higher than the 
high thresholds in the two or more images of the first 

60 group; 

a third process of calculating for each pixel a quantity 
representing the magnitude of change of density in an 
area neighboring each of the pixels making up a single 
image selected from the first group of images, compar- 
es ing a change of density in the background region with 
the quantity representing the magnitude of change of 
density calculated for each pixel, setting a second 
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group of thresholds for extracting object regions whose change of density calculated for each pixel, to set a 

change of density is larger than that of the background second group of thresholds for extracting object regions 

region, and producing a second binary image from the whose change of density is larger than that of the 

single image, the third process being performed in background region, and to produce a single image; and 

parallel with the second process; and 5 a third binarization means to perform a logic operation od 

a fourth process of performing a logic operation on (he ***** ^ ^ and mc ^ ^ * 

first binary imag^nd the second binary image to **<* uoe » <JJ ^ I ^* owing back S round 

produce a third binary image showing the background jj^gton se^ntaUo^a^aratus for particle images 

region and the object, according to claim 20. wherein the particle images are 

15. A region segmentation method for particle images « . cs of ^ non . stainc d urine sediment particles 
according to claim 14. wherein the particle images are scattered in a flow. 

images of stained and non-stained urine sediment particles 2Z A region segmentation apparatus for particle images 

scattered in a flow. according to claim 20. further comprising a means to correct 

16. A region segmentation method for particle images density irregularities present in the first group! of images 
according to claim 14, wherein the first group of images is 15 using a white image photographed when an object has a 
the green-colored Image and the redcolored image, and the uniform and infinitely small light absorption and a black 
single image is the green-colored image. image photographed when an object has an infinitely large 

17. A region segmentation method for particle images light absorption, the density irregularities being caused by 
according to claim 14, wherein either a difference between distortion of the image input optical system, 

sums of density values of pixels contained in each of two 20 23. A region segmentation apparatus for particle images 

small areas neighboring each of the pixels, or an absolute according to claim 20, wherein the first group of images is 

value of the difference between the density sums is taken as * c green-colored image and the redcolored image, and the 

the quantity representing the magnitude of change of den- sin S le "aage is the green-colored image. 

s ity. 24. A region segmentation apparatus for particle images 

18. A region segmentation method for particle images M according to claim 20. wherein at least a portion of an 
according to claim 17, wherein the small areas have a size operation of each of the first binarization means and the 
of two to four pixels arranged onedimensionally in a sped- second binarization means are at least parallelly operated 
fied direction in the single image. M - A TC &°* segmentation apparatus for particle images 

19. A region segmentation method for particle images according to claim 20, wherein the first binarization means 
according to claim 20, wherein the first process comprises a 30 and the second binarization means are at least parallelly 
step of generating a density histogram for each of images of operated. 

the first group of images to determine the low and high 26. A region segmentation apparatus for particle images 

thresholds, wherein the low thresholds are lower than a according to claim 20, wherein the logic operation in the 

maximum density value of the density histogram, and the third binarization means is a logical OR. 

high thresholds are higher than the maximum density value 3* 27- A region segmentation apparatus for particle images 

of the density histogram. according to claim 20, further comprising a means to deter- 

20. A region segmentation apparatus for particle images mine either a difference between sums of density values of 
comprising- pixels contained in each of two small areas neighboring each 

an image input optical system for inputting particle «f *f P*f ls or " ^ solutc v * luc ° f ^^^J*^ 0 

ima "T, r r~ 40 the density sums, wherein either the difference between the 

, . . density sums or the absolute value of the difference is taken 

a means to generate a red-colored image, the green- as ^ representing the magnitude of change of 

colored linage and a blue-colored image of stained and , 

non-stained object particles as static images; 28.A region segmentation apparatus for particle images 

a memory means to store image data of the red-colored 43 according to claim 27. wherein the small areas have a size 

image, green-colored image and blue-colored image; of ^ 0 to f our ^x t ^ arranged one-dimensionally in a 

a first binarization means to set a first group of thresholds specified direction in the single image, 

in density value for a first group of two or more images 29. A region segmentation apparatus for particle images 

selected from the redVcolored image, green-colored according to claim 20. further comprising a means to deter- 

image and blue-colored Image to discriminate between 50 min e either a weighted sum of the density values of pixels 

a background region and object regions where the m the small area neighboring each of the pixels or an 

object particles exist, and to extract object regions absolute value of the weighted sum. wherein either the 

differing in density from the background region, and weighted sum or the absolute value of the weighted sum is 

producing a first binary image from the first group of taken as the quantity representing the magnitude of change 

images, wherein the first group of thresholds are low 55 of density. 

thresholds and high thresholds in density value and the 30. A region segmentation apparatus for particle images 

first group of thresholds are set for the two or more according to claim 29. wherein the small area has size of two 

images of the first group, and density values of pixels t0 f our pixels in a specified directions in the group image, 

of the extracted object regions are lower than the low 31. a region segmentation method for particle images 

thresholds or higher than the high thresholds in the two $o according to claim 20. further comprising a means to deter- 

or more images of the first group; mine either a variance or a standard deviation of distribution 

a second binarization means to calculate for each pixel a of density of pixels in the small areas neighboring each of 

quantity representing the magnitude of change of den- the pixels, wherein either the variance or the standard 

sity in an area neighboring each of the pixels making up deviation is taken as the quantity representing the magnitude 

a single image selected from the first group of images, 65 of change of density. 

to compare a change of density in the background 32. A region segmentation apparatus for particle images 

region with the quantity representing the magnitude of according to claim 20. wherein the first binarization means 
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comprises a threshold calculating unit to generate a density 
histogram for each of images of the first group of images and 
to determine the low and high thresholds, wherein the low 
thresholds are lower than a maximum density value of the 
density histogram, and the high thresholds are higher than s 
the maximum density value of the density histogram. 

33. A region segmentation apparatus for particle images 
comprising: 

an image input optical system for inputting particle 
images; 10 

a means to generate a red-colored image, a green-colored 
image and a blue-colored image of stained and non- 
stained object particles as static images; 

a memory means to store image data of the red-colored ^ 
image, green-colored image and blue-colored image; 

a means to correct density irregularities present in a first 
group of two or more images selected from using a 
white image photographed when an object has a uni- 
form and infinitely small light absorption and a black ^ 
image photographed when an object has an infinitely 
large light absorption, the density irregularities being 
caused by distortion of the image input optical system; 

a first binarization means to set a first group of thresholds 
in density value for the first group ofimages to dis- 2 s 
criminate between a background region and object 
regions where the object particles exist, and to extract 
object regions differing in density from the background 
region, and producing a first binary image from the first 
group of two or more images wherein the first group of 
thresholds are low thresholds and high thresholds in 
density value and the first group of thresholds are set 
for the two or more images of the first group, and 
density values of pixels of the extracted object regions 
are lower than the low thresholds or higher than the 35 
thresholds in the two or more images of the first group; 

a second binarization means to calculate for each pixel a 
quantity representing the magnitude of change of den- 
sity in an area neighboring each of the pixels making up 
a single image selected from the first group of images. 40 
to compare a change of density in the background 
region with the quantity representing the magnitude of 
change of density calculated for each pixel to set a 
second group of thresholds for extracting object regions 
whose change of density is larger than that of the 45 
background region, and to produce a second binary 
image from the single image, the second binarization 
means being operated in parallel with the first bina- 
rization means; and 

a third binarization means to perform a logic operation on so 
the first binary image and the second binary image to 
produce a third binary image showing the background 
region and the object regions. 

34. A region segmentation apparatus for particle images 
according to claim 33. wherein the particle images are 55 
images of stained and non-stained urine sediment particles 
scattered in a flow. 

35. A region segmentation apparatus for particle images 
according to claim 33. wherein the first group of images is 
the green-colored image and the redcolored image, and the 60 
single image is the green-colored image. 

36. A region segmentation apparatus for particle images 
according to claim 33. further comprising a means to deter- 
mine either a difference between sums of density values of 
pixels contained in each of two small areas neighboring each 65 
of the pixels or an absolute value of the difference between 
the density sums, wherein either the difference between the 
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density sums or the absolute value of the difference is taken 
as the quantity representing the magnitude of change of 
density. 

37. A region segmentation apparatus for particle, images 
according to claim 36. wherein the small areas have a size 
of two to four pixels arranged one-dimensionally in a 
specified direction in the single image. 

38. A region segmentation apparatus for particle images 
according to claim 33. wherein the first binarization means 
comprises a threshold calculating unit to generate a density 
histogram for each of images of the first group of images and 
to determine the low and high thresholds, wherein the low 
thresholds are lower than a maximum density value of the 
density histogram, and the high thresholds are higher than 
the maximum density value of the density histogram. 

39. A region segmentation method for particle images 
comprising: 

photographing and storing as static images a red compo- 
nent image (red-colored image), a green component 
image (green-colored image) and a blue component 
image (blue-colored image) of stained and non- stained 
object particles supplied through an image input optical 
system: 

a first process of setting a first group of thresholds in 
density value for two images selected from the red- 
colored image, green-colored image and blue-colored 
image to discriminate between a background region 
and object regions where the object particles exist and 
to extract object regions differing in density from the 
background region, and producing a first binary image 
from the two images, wherein the first group of thresh- 
olds are low thresholds and high thresholds in density 
value and the first group of thresholds are set for each 
of the two images, and density values of pixels of the 
extracted object regions are lower than the low thresh- 
olds or higher than the high thresholds; 

a second process of calculating for each pixel a quantity 
representing the magnitude of change of density in an 
area neighboring each of the pixels making up single 
image selected from the two images, comparing a 
change of density in the background region with the 
quantity representing the magnitude of change of den- 
sity calculated for each pixel, setting a second group of 
thresholds far extracting object regions whose change 
of density is larger than that of the background region, 
and producing a second binary image from the single 
image; and 

a third process of performing a logical OR operation on 
the first binary image and the second binary image to 
produce a third binary image showing the background 
region and the object regions. 

40. A region segmentation method for particle images 
comprising: 

photographing and storing as static images a red compo- 
nent image (red-colored image), a green component 
image (green-colored image) and a blue component 
image (blue-colored image) of stained and non- stained 
object particles supplied through an image input optical 
system; 

a first process of correcting density irregularities present 
in two images selected from the red-colored image, 
green-colored image and blue-colored image using a 
white image photographed when an object has a uni- 
form and infinitely small light absorption and a black 
image photographed when an object has an infinitely 
large light absorption, the density irregularities being 
caused by distortion of the image input optical system; 
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a second process of setting a first group of thresholds in 
density value for two images to discriminate between a 
background region and object regions where the object 
particles exist and to extract object regions differing in 
density from the background region, and producing a 5 
first binary image from the two images, wherein the 
first group of thresholds are low thresholds and high 
thresholds in density value and the first group of 
thresholds are set for each of the two images, and 
density values of pixels of the extracted object regions 
are lower than the low thresholds or higher than the 
nigh thresholds; 

a third process of calculating for each pixel a quantity 
representing the magnitude of change of density in an 
area neighboring each of the pixels making up single 
image selected from the two images, comparing a 13 
change of density in the background region with the 
quantity representing the magnitude of change of den- 
sity calculated for each pixel, setting a second group of 
thresholds for extracting object regions whose change 
of density is larger than that of the background region. 20 
and producing a second binary image from the single 
image, the third process being performed in parallel 
with the second process; and 

a fourth process of performing a logical OR operation on 
the first binary image and the second binary image to 25 
produce a third binary image showing the background 
region and the object regions. 

41. A region segmentation apparatus for particle images 
comprising: 

an image input optical system for inputting particle 
images; 

a means to generate a red-colored image, a green-colored 
image and a blue-colored image of stained and non- 
stained object particles as static images; 33 

a memory means to store image data of the red-colored 
image, green-colored image and blue-colored image; 

a first binarization means to set a first group of thresholds 
in density value for two images selected from the 
red-colored image, green-colored image and blue- 40 
colored image to discriminate between a background 
region and object regions where the object particles 
exist and to extract object regions differing in density 
from the background region, and producing a first 
binary image from the two images, wherein the first 45 
group of thresholds are low thresholds and high thresh- 
olds in density value and the first group of thresholds 
are set for each of the two images, and density values 
of pixels of the extracted object regions are lower than 
the low thresholds or higher than the high thresholds; 50 

a second binarization means to calculate for each pixel a 
quantity representing the magnitude of change of den- 
sity in an area neighboring each of the pixels making up 
single image selected from the two images, to compare 
a change of density in the background region with the 55 
quantity representing the magnitude of change of den- 
sity calculated for each pixel, to set a second group of 
thresholds for extracting object regions whose change 
of density is larger than that of the background region, 
and to produce a second binary image from the single 60 
image; and 

a third binarization means to perform a logical OR 
operation on the first binary image and the second 
binary image to produce a third binary image showing 
the background region and the object regions. 65 

42. A region segmentation apparatus fox particle images 
comprising: 



an image input optical system for inputting particle 
images; 

a means to generate a red-colored image, a green-colored 
image and a blue-colored image of stained and non- 
stained object particles as static images; 

a memory means to store image data of the red-colored 
image, green-colored image and blue-colored image; 

a means to correct density irregularities present in two 
images selected from the red-colored image, green- 
colored image and blue-colored image using a white 
image photographed when an object has a uniform and 
infinitely small light absorption and a black image 
photographed when an object has an infinitely large 
light absorption, the density irregularities being caused 
by distortion of the image input optical system; 

a first binarization means to set a first group of thresholds 
in density value for the two images to discriminate 
between a background region and object regions where 
the object particles exist, and to extract object regions 
differing in density from the background region, and 
producing a first binary image from the two images, 
wherein the first group of thresholds are low thresholds 
and high thresholds in density value and the first group 
of thresholds are set for each of the two images, and 
density values of pixels of the extracted object regions 
are lower than the low thresholds or higher than the 
high thresholds; 

a second binarization means to calculate for each pixel a 
quantity representing the magnitude of change of den- 
sity in an area neighboring each of the pixels making up 
single image selected from the two images, to compare 
a change of density in the background region with the 
quantity representing the magnitude of change of den- 
sity calculated for each pixel, to set a second group of 
thresholds for extracting object regions whose change 
of density is larger than that of the background region, 
and to produce a second binary image from the single 
image, the second binarization means being operated in 
parallel with the first binarization means; and 

a third binarization means to perform a logical OR 
operation on the first binary image and the second 
binary image to produce a third binary image showing 
the background region and the object regions. 

43. A region segmentation method for particle images 
comprising: 

photographing and storing as static images a red compo- 
nent image (red-colored image), a green component 
image (green-colored image) and a blue component 
image (blue-colored image) of stained and non-stained 
object particles supplied through an image input optical 
system; 

a first process of correcting density irregularities present 
in the red-colored image and the green-colored image 
using a white image photographed when an object has 
a uniform and infinitely small light absorption and a 
black image photographed when an object has an 
infinitely large light absorption, the density irregulari- 
ties being caused by distortion of the image input 
optical system; 

a second process of setting a first group of thresholds in 
density value for the red-colored image and green- 
colored image to discriminate between a background 
region and object regions where the object particles 
exist and to extract object regions differing in density 
from the background region, and producing a first 
binary image from the red-colored image and green- 
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colored image, wherein the first group of thresholds are 
low thresholds and high thresholds in density value and 
the first group of thresholds are set for the red-colored 
image and green-colored image, and density values of 
pixels of the extracted object regions are lower than the s 
low thresholds or higher than the high thresholds; 

a third process of calculating for each pixel a quantity 
representing the magnitude of change of density in an 
area neighboring each of the pixels making up the 
green-colored image, comparing a change of density in 10 
the background region with the quantity representing 
the magnitude of change of density calculated for each 
pixel, setting a second group of thresholds for extract- 
ing object regions whose change of density is larger 
than that of the background region, and producing a 13 
second binary image from the green -colored image, the 
third process being performed in parallel with the 
second process; and 

a fourth process of performing a logical OR operation on 
the first binary image and the second binary image to 
produce a third binary image showing the background 
region and the object regions. 

44. A region segmentation apparatus for particle images 
comprising: 

an image input optical system for inputting particle 
images; 

a means to generate a red-colored image and a green- 
colored image of stained and non-stained object par- 
ticles as static images; 30 

a memory means to store image data of the red-colored 
image and the green-colored image; 

a means to correct density irregularities present in the 
red-colored image and the green-colored image using a 
white image photographed when an object has a uni- 
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form and infinitely small light absorption and a black 
image photographed when an object has an infinitely 
large light absorption, the density irregularities being 
caused by distortion of the image input optical system; 

a first binarization means to set a first group of thresholds 
in density value for the red-colored image and green- 
colored image to discriminate between a background 
region and object regions where the object particles 
exist, and to extract object regions differing in density 
from the background region, and producing a first 
binary image from the red-colored image and green- 
colored image, wherein the first group of thresholds are 
low thresholds and high thresholds in density value and 
the first group of thresholds are set for the red-colored 
image and green-colored image, and density values of 
pixels of the extracted object regions are lower than the 
low thresholds or higher than the high thresholds; 

a second binarization means to calculate for each pixel a 
quantity representing the magnitude of change of den- 
sity in an area neighboring each of the pixels making up 
the green-colored image, to compare a change of den- 
sity in the background region with the quantity repre- 
senting the magnitude of change of density calculated 
for each pixeL to set a second group of thresholds for 
extracting object regions whose change of density is 
larger than that of the background region, and to 
produce a second binary image from the green-colored 
image, the second binarization means being operated in 
parallel with the first binarization means; and 

a third binarization means to perform a logical OR 
operation on the first binary image and the second 
binary image to produce a third binary image showing 
the background region and the object regions. 
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